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The  outside  scene  is  cTten  an  iriportant  source  of  infor::iation  fc: 
o^r.trol  tas>.3.  Ir.cortant  e;-:ar.ples  cf  these  are  car  driving  and  aircra: 
Lntrol.  This  paper  deals  vith  rsodeliing  this  visual  scene  percepticr. 
rrocess  on  the"  basis  of  linear  perspective  geonietry  and  the  relative  ; 
cues  • 


nual 


on 


Model  predictions  uti. 
exoerinients  and  literature 
ccrpared  w'ith  experimental 
illustrate  that  the  model 
vcrld  perception  process. 


ining  psychophysical  threshoiJ  data  f 
of  a  variety  of  visual  approach  tasks 
cata.  Both  the  perform.ance  and  worklo 
rcvides.  a  meaningful  description  of  t 
■ith  a  useful  predictive  capability. 
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Many  manual  control  t; 
outside  scene.  In  the  cont' 
example  is  the  visual  appr' 
many  flight  situations  in 
into  account  this  visual  s 
impact  on  mission  performa 


US  depend  on  the  visual  perception  of  the 
:t  of  aircraft  ccntrci,  the  most  important 
.ch  scene.  3o,  in  order  to  investigate  a  gre 
.e  approach  and  landing,  it  is  mandatory  to 
■ne  perception  process  which  has  often  a  m.a; 


at 

take 


Based  on  a  concise  inv 
[cues)  of  the  visual  scene 
i modelled)  on  the  basis  of 
action  cues.  This  involves 
cues  and  the  aircratt  state' 
integrated  in  the  existing 
(the  optimal  control  model) 
The  visual  scene  perce 
perceptual  thresholds  of  th 
observing  th.ese  cues  and  in 
are  derived  from  baseline  e 
hvsical  literature.  Based 
er formed  dealing  with  a  va 


er:tcry  of  tiie  most  important  characteristics 
the  visual  scene  perception  process  is  describeu 
the  linear  perspective  geometry  and  the  relative 
mathematical  relationships  between  these  visual 
’  variables.  After  linearisation  this  model  can  be 
framework  describing  piloted  aircraft  behavior 
.  This  is  the  subject  of  the  next  chapter, 
ttion  model  imoives  assumptions  concerning 
e  various  cues,  noise  levels  associated  with 
terference  among  them.  Values  for  these  tvar-imeters 
■xperimental  data  supplemented  hy  the  psyche- 
on  these  values  a  theoretical  analysis  is 
riety  of  visual  approach  conditions. 
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Furthermore, the  results  of  an  experimental  program  are  compared  vit,h  the 
model  predictions.  In  addition,  rodel  predictions  of  pilot  workload  are  compared 
with  subjective  ratings. 


VISUAL  SCE^E  PEECEPTIC:;  MODEL 


One  of  the  earliest  studies  of  visual  s^ene  perception  directly  related 
to  flight  control  problems  has  been  performed  by  Gibson  (Refs.  '  and  2}. 
According  to  Gibson,  the  most  important  visual  cues  which  can  be  derived 
from  the  visual  field  are  related  to 

,  the  linear  perspective  geometry 
.  relative  motion  or  motion  parallax 

•  the  apparent  size  of  objects  whose  real  size  is  kno’wn 
.  a  far  object  covered  by  a  near  one 
.  the  distribution  of  flight  and  shade  over  an  object 
.  aerial  perspective  and  the  loss  of  detail  with  distance. 


Of  these,  the  linear  perspective  geometry  provides  a  variety  of  cues. 
This  is  illustrated  by  the  schematic  version  of  the  visual  scene  in  fig-are  la 
which  can  be  thought  of  to  consist  of  lines  and  points  (textural  elements). 
This  involves  not  only  the  linear  and  ai.gular  position  of  the  observer  with 
respect  to  the  outside  world  but  also  (dynamically)  the  relative  motion. 

The^ point  of  the  visual  field  toward  which  the  observer  is  moving  appears  to 
be  stationary  ('’focus  of  expansion").  All  ether  textural  points  move  with 
respect  to  the  observer  which  can  be  indicated  by  velocity  vectors 
("streamers").  This  is  shown  in  fig’ore  ib  for  the  case  of  rectilinear  motion. 
Various  other  references  mention  visual  cues  which  can  be  conceived  as 
examples  of  the  afore-mentioned  basic  elements.  Most  of  them  are  related  to 
the  landing  approach  scene  (Refs.  3-5). 


From  the  foregoing  it  can  be  derived  that  a  reasonable  approach  is  to 
model  the  visual  scene  perception  process  on  the  basis  of  the  linear 
perspective  geometry  and  the  relative  notion  cues.  Following  reference  6 
this  involves  a  description  of  the  cues  which  can  be  derived  from  the  visual 
scene  and  their  functional  relationships  with  linear  and  angular  positions 
and  velocities  of  the  observer.  When,  in  addition,  the  relationships  between 
the  moving  observer  and  the  visual  scene  can  be  linearized  about  a  nominal 
condition,  the  perception  process  can  be  described  in  standard  estimation 
theoretical  terms  and  included  in  the  optimal  control  model  structure  in  the 
following  manner. 

Let  the  observer  (aircraft^)  moving  with  respect  to  the  outside  world 
be  described  by  the  system  state  v(t),  This  involves  the  common  linear  and 


Although  the 
this  analysis 


following  applies  to  a  variety  of  man-machine  situations 
is  directed  at  the  aircraft  control  problem. 
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aircraft  as  veil  as  additional  naracete-s  to  -e-c>-i>-e 

a^cr^ftj.  After  linearization  about  a  nominal  path  the  result  v-^  >«^’  — 
f  -xnear,  >  m  general)  time-varying  equations  given  by  """  “ 

x(t)  =  A(t)  x(t)  +  i:{t)  w(t)  !,■ 

'.  ‘  / 

where  A(t)  describes  the  process  of  the  aircraft  moving  v-'th  resne-t  tr  -> 

represents  system,  disfurbances^:  e::'  SKnelV"" 
^urtheraore,  the  visual  cues  will  be  described  by  the  distiay  ve— o-  ^ 

-he  relationships  between  these  disnlayed  var-^ables  and  s”s*e- 

given  by  ...e  s^s^er.  state  is 


y(t)  =  c(t)  x(t) 

The  perception  of  these  variables  is  accompanied  with  an  ecu--, 
e  aj ,  perceptual  thresholds  and  observation  noises.  A’-o  the  -r 
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considered  (Refs.  7  and  8).  How.  * 
aealt  with  in  the  same  fashion 

iisplays,  motion  cues.  etc.),  me  system  state  is  estir.a-.ed  oct’- 
-eans  oi  a  .<alman-Bucy  filter)  on  the  basis  of  r  ‘ 


a.o.  arizing  from  the 
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has  so  be 

these  observations  cf 
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scene 

onservations  from  Gtl^ 

^er  sources 
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involved  and  the  observations.  This  state  estLmation  tr 
as  an  internal  representation  of  the  task  environment'. 
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ess  can  : 


:ynar 

nens 


ICS 


..e  a.^-.^r.o.'-.ips  t-.-t-.c-en  vis-aai.  scene  c.haracteristics  and  the  syste.m 

A  schematic  version  of  the  vis-aal  scene  (Fig.  l)  c.an  'c 
co.mpri3e  textural  ele.ments  and  known  objects.  Both  trov'de 
geometrical  cues  v basically,  the  i.nclir.ation  of  lines) 
relative  position  and  velocity. 


assur.ed 
Lnear  pe> 
inrecr  * 


late 
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snec  t i ve 


The  inclination  ii  ,  of  a  line  element  of  the  visual  see 
12  =  tan"*  Y/H 

distance  cetveen  the  observer  and  the  nert''^-^ 
itrrpendicular  to  the  locking  direction  and  H  is  '"he 
sserver.  Assuming  small  perturbations  (y,  h  and  c>)  arcunri: 

To*  “o  results  after  some  maninulation  (to  a  '"‘-s-  • 

■inear  expression 
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■  here 


w  =  C.^  h  +  C  y 


-^^erentiating  eg  (^a)  yields  the  expression  I'cr  the  in.i^ ' -r.- - 
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where  a  is  the  visual  angle  and  R  is  the  distance  oetween  the  object  and 
the  observer. 


Furthermore,  when  the  attitude  of  the  observer  (aircraft)  is  taken  into 
account  (with  attitude  angles  (p,  ^  and  u  )  eqs.  (4)  and  (5)  become 

ai  =  C.  h  +  C  y  +  9 
n  y 

a.^  =  h/R  +  (6) 

=  y/^  *'■ 

and  the  corresponding  time-derivatives  <!>  =  etc. 

Next,  these  expressions  are  utilized  to  describe  the  cues  which  can  be 
derived  from  the  visual  approach  scene. 

Visual  approach  scene 

A  schematic  version  of  the  visual  approach  scene  is  shown  in  f ignore  2. 

The  cues  which  are  assumed  to  be  derived  from  this  scene  are  indicated. 

Ihe  most  imrortant  cue  for  lateral  guidance  is  derived  from  the  inclination 
of  the  runway  sides  and/or  centerline.  The  lateral  deviation  y,  is  zero  if 
the  inclination  of  both  runway  sides  is  the  same  =  oj^)  and  the  inclination 
of  the  centerline  is  zero  =  O). 

Vertical  guidance  has  to  be  cased  on  the  (average)  inclination  of  the  runway 
sides  when  no  runway  end  and  no  horizon  is  visible.  In  that  case,  the 
observer  has  to  know  the  nominal  inclination  which  is  range-varying. 

The  following  model  analysis  and  experimental  results  will  show-  that  a  better 
indication  of  the  vertical  position  is  obtained  when  the  length  of  the 
runway  a.  (or,  almost  equivalently,  the  depression  of  runway  threshold  with 
respect  §c  the  horizon)  is  visible.  Also  in  that  case,  the  observer  has  to 
know  the  nominal  depression  which  is,  however,  constant  d^uring  a  standard 
approach  (e.g.,  3  deg). 

Glide  sloce  information  requires  also  the  estimation  of  the  distance  to 
tcuchaown.  This  can  be  based  on  the  apparent  size  of  ground  objects,  of  which 
the  most  important  is  often  the  runway  width. 

Aircraft  attitudes  provide  inner-loop"  information  and  can  be  derived  from 
the  relative  cositicn  and  inclination  of  (e.g.)  the  horizon  and  any  aircraft 
reference.  The  pitch  angle  which  has  to  be  estimated  with  respect  to  its 
(non-zero)  nominal  value  and  the  Q.ngle  9  are  indicated  lu  figure  2. 


f 
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The  linear  visual  scene  perception  model  (VSPM)  can  be  impleme>r-ed  in 
t:ie  optimal  contrci  model  (Refs.  6  and  7).  Eased  on  the  foregoing  discussion, 
a  variety  of  visual  approach  conditions  are  selected  to  analyse  theoretically. 
In  addition,  an  ez-iperiinental  program  has  been  conducted  to  provide  a  critical 
test  for  the  hypotheses  (assumptions)  underlying  the  model  results.  In  order 
to  obtain  detailed  information  concerning  the  information  processing  involved 
in  the  manual  approach  task,  no  range-varying  effects  are  considered  in  trie 
fclloving  analysis.  In  other  words,  it  is  assumed  that  the  aircraft  is  ’’fronerf* 
at  a  fixed  point  of  the  approach  path  correstonding  with  a  nominal  altitude  of 
iOO  ft  for  a  3^  approach  ("hovering").  The  consequence  is  a  stationary  process 
involved  allowing  frequency  'iomain  measures  such  as  human  describing  luncticns 
and  observation  noise  spectra.  Especially  trie  latter  will  provide  a  sensitive 
cneck  on  the  exactness  of  the  values  used  for  the  model  parameters  ur.ier 
investigation.  The  primary  model  parameters  are  the  perceptual  thresholds  of 
the  various  visual  cues  (display  elements)  involved  because  these  represent 
the  most  uncertain  model  parameters.  The  results  of  several  pr^.-vious 
exr.erimentai  studies  suggest  reasonable  accurate  values  for  ti.e  remaining  i:ic\h}’;. 
parameters • 

Therefore,  case-line  experiments  have  been  conducted  and  relevant  psyc'no- 
ohysical  literatui’e  have  been  searciied  resulting  in  reasonable  reliable 
estimates  for  the  perceptual  thresholds  involved.  Finally,  the  last  .'ection 
contains  the  model  analysis  proper  and  the  resulting  model  predictions. 


Visual  scene  conf ig'irations 


Referring  to  the  foregoing  discussion  the  conf igurations  given  in  figure 
3  were  selected  for  the  following  model  analysis  and  formal  experimer.t . 

Vertical  control  on  the  basis  of  the  inclination  of  the  runway  sties 
can  be  compared  with  the  condition  that  the  uepressicn  of  the  runway 


■eshold  below  the  runway  end  (a)  or  below  the  horisen  is  visible 
nfigurations  1  and  2),  Furthermore,  the  effect  of  an  aircraft  reference 
viding  explicitlp'  pitch  information  is  of  interest  ■ conf iguration  i . . 

Lateral  control  utilising  the  inclination  of  the  centerline  is 
:re3ented  by  conf iguration  -.  In  case  the  runway  sides  are  available,  the 
’linaticri  of  bet;:  sides  has  to  be  estimated  and  compared  with  each  ttner 
infiguration  o)-  A  simple  model  analysis  shews  that  this  prccess  is 
;ociated  with  the  same  observation  noise  as  in  the  case  of  a  center  line. 
:j  the  perceptual  thresholds  involved  are  different  (next  section).  This 
.1  be  tested  against  the  experimental  results.  Again  the  effect  of 
:licit  roll  information  provided  by  the  aircraft  reference  is  consiiered 
including  cenf iguration  6.  Conf iguration  7  :cncerns  roll  tracking  based 
the  aircraft  reference.  This  ( pres'cmabiy )  easy  task  is  ii:cluded  to  -;vcke 
:e  variation  in  workload  in  order  to  yield  additional  experimental 
.ience  for  the  workload  model  of  reference  c  an'i  to  test  the  percerrual 
•eshold  assujcpticns  involved. 
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Configurations  3  and  9  are  selected  to  investigate  the  interference 
between  vertical  and  lateral  control.  It  is  assuned  that  tne  pij.ot  nas  .  o 
divide  his  attention  between  the  various  display  variables  (visuaj.  scene 
cues)  involved.  This  interference  is  assumed  not  only  within  a  control^task 
(e.g.  attention  has  to  be  divided  between  pitch  angle  a.nu  altitude,  buu  also 
between  vertical  and  lateral  control  when  performing  botn  tasks  sinu*^.aneousl.  . 
■^his  represents  a  crucial  hypothesis  which  will  be  testec  in  the  :ol..owing 
as  the  visual  scene  is  widely  assumed  to  represent 

and  it  is  a  non-trivial  question  whether  the  visual  scene  can  be  brok  n 
down"  into  separate  eleme.nts.  Finally,  configuration  10  is  includea  to 
investigate  the  effect  of  additional  texture.  This _ has,  in  principle,  its 
implications  for  the  information  contents  of  the  visual  scene  wnicn  tuined 
out  to  be  of  no  interest  but  also  for  the  psychological  aspects  (perspective 
illusion  and  realism). 

Perceptual  thresholds 

It  was  anticipated  that  perceptual  threshold  phenomena  could  he 
•'mtortant  for  the  foregoi.ng  visual  sce.ne  cues,  ■.ruresnolus  can  ce^ accounted 
*'or  in  the  optimal  control  model  by  modifying  the  observation  .noise 
covariance  associated  with  a  particular  visual  cue. 

Although  the  psychop.hysical  literature  reports  a  wealth  of  emperical  ^ 
threshold  data,  these  data  are  k.ncwm  to  be  affected  by  .v^erous  e.perimer.ta. 
conditions  which  easily  explains  t.ne  typical  scatter  in  ^  compara..xe  ua^a. 
Therefore,  a  baseline  e.xperiment  has  been  conducted  to  cetermine  t.ne  position 
thresholds  of  the  display  elements  involved  in  the  visuau^scene^cor.figi^aticns 
anown  in  figure  i.  Inese  chresnc^us  are  primal..-,.  vi.e 

visual  references  concerning  zero  or  nominal,  visuaj.  scene  condiu^^n^. 

This  involves  that  learning  'experience)  and  temporal  cues  , memory 
functioning)  are  important  in  measuri.ng  a.nd  interpreti.ng  thresho_ds. 

.-v.  v^e^erence  The  resulting  measurements 

Lxnerimentai  uctai^o  are  ^ ^  ^ 

'^re  "translated’*  to  values  suitable  for  (as  required  oy ;  the  aescriwing 
function  representation  for  the  ass'-nr.ed  dead-cone  non-linearity.  The  results 

are  summarized  in  table  T.  .  ,  •  ,  4- • 

As  discu'^sed  in  reference  9  tnresholds  associated  W4.^h  the  perception 
of  motion  in  ^he  visual  field  can  be  related  to  resolution  properties. ^This 
imtlies  that  the  motion  detection  tnresholds  can  ce ^ ina. -^rrea  from  -ne  x0..e- 
going  discrimination  data.  The  result  is  also  contained  in  tab^e  . 

Acart  from  these  (nominal)  threshold  estimates,  in  table  1  it  is  also 
indicated  how  reliable  these  estimates  are  assumed  to  be.  A^sensitivity 
analysis  in  the  following  will  ser-ve  to  relate  this  incertainty  in  tnreshold 
values  to  a  confidence  interval  associated  with  the  system  performance 
predictions  of  the  model. 

vcdei  predicuicr.s 


A  block  diagram  of  the  control  task(3)  is  given  in  figure  U.  System 
disturbance  enters  the  system  parallel  to  the  control  i.nput.  The  resulting 
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operator  as  the  pitch  and  roll  angle  (^’or 
-he  pertinent  coni igurat ions)  representing  K-dynamics.  The  integral  of  the-e 

lin^rc^W^^  lateral  deviation  (or  center 

ioi^e  nro  '  r  ’  f U/s-dynanics ) .  The  disturbances  are  vhi^f 

levels  are  I’qr  the  vertical  task  given  i:y  a 
resutt-"^  ?-tch  variance  of  O.068  aeg^  and  for  the  lateral  task  given  by  a 
*--•1^  ^  t  variance  of  10.5  deg^  (corresponding  with  the  values  used  for 

'  P®P^^P“  concerning  sensitivities  and  , rains 
invol/ea  are  coutainea  in  reference 


vni 


1:';  are  ccnist 
:iie  remainl 


ar.t 
■S  .'T. 


^..caei.  oarameuer s  can  be  ilivitied.  in  carane'ter'j 
conf  iprations  and  parajiieters  which  are  considered 
variables.  Also  the  experimental  results  of  the  next  chaoter  wi’i 
to  tr.ese  Uependent)  variables.  The  key  variables  are  t:ie  nercectu 
^ne  riumina^  values  of  table  1  are  assumed  for  the  model  rredict’'o- 
rurthermore,  the  effect  of  the  upper-  and  lower  threshold  valu;^ 
sjstem  ou^puos  is  also  aetermined  and  discussed  in  the  -'ollowi-r  - 
overa_l^  level  of  attention  (P^)  is  also,  to  sam.c  extent,  variable; 
oSio  -.--ue  .-’.as  ceen  sr.cwn  in  previous  studies  to  be  relativolv  cc- 
ncmir.al  ya-ue  of  -20  13  is  assumed  and  the  effect  of  +  1  dB  or.  thl-^ 
outputs  IS  considered. 

The  constant  model  para-meters  are:  a  neuro-motor  time  'o-stant  c*-  n  - 
a  perceptual  time  delay  of  0.2  sec  a;vd  a  motor  .noise  ratio  of  -30  di^ 

..cw,  assuming  that  the  human  operator  divides  his  --ttentior 
Visual  cues  rositior'  -rj  ^ 

^  ‘  "'1  exeinur.osj  opLinaliv 

..ne^given  cost  fu.nctior.ai;  (.Pef.  3),  system  ?.;-rfor.mar.ce  c‘a; 


on 


a. 

.St' 


I 

''<r.  1  '1  < 

thre: 

the 

ter. 

theuft 


all 

:ed 

:holxi 


predicted  tor  tne  various  cenfigurat lens . 


,  1.- 

f  >J0 


results  'ire  given  in  zal^t- 


Vertical  control  is  superior  for  the  condition  that  the  rur.wa- 
uepression  angle  and  the  pitch  a.ngl-.-,  can  be  observed  .c'-  f  3) 

DUticn  of  the  pitch  information  amounts  to  a  20  1  reduction  of*thl'.- 
a.ngle  varta.nce  \  ,r  of  conf.  2).  whe.n  the  viewing  conaition  is  sue’-’-  lu 
norizc.n  or  runway  end  to  visible  and  control  !:as  to  be  ;  or-'el‘ 
sides  \OK  ana/or  u;^)  ana  runway  threshold  variation  (d)  the  vert-’.--- 1 
performance  is  degraded  substantially.  This  clearly  de.-it—.la-el'l 
contricutic.n  of  the  various  visual  cues  involv-.-d.  h'urthermcre.^  in''l.. 
both  vertica.  a.nd  lateral  control,  ti-.e  vertical  aporoacr.  oerfor-a--> 
predictea  to  deteriorate  with  20  >:  to  -;o  (.due  to'ti.e  assuir.ed  intcl--^ 
oetween  cct.n  tasks  1 .  The  la.ot  col'amn  cf  table  I  contains  the  (opti.ml 
xracoj.cn3  ci  attcnt<.ion  dedicated  to  the  various  cues. 


:ntri- 
:roacr. 
Lt  nc 
.nvay 
Tji;rca( 


.mv*,-!. r"  .ti. 


The  best  lateral  approach  perfor.mance  is  obtained  wnpn  th*-  run'-’- 
centerline  i.nclination  io,  )  cue  is  available  (conf.  1).  laterl  cortl- 
utilizing  the  runway  sides  is  substantially  degraded  5)  =uc  - 

larger  perceptual  threshold  of  this  cue.  The  bank  an.gle  uso--“ 
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ictiOi'io  ^±ve::  to  tne  subject 
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is  ve^gned  yielding  the  neuro-motor  time  censte 
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inner  loop  information  (conf.  6).  When  performing  the  vertical. and  lateral, 
task  simultaneously,  the  model  predicts  a  deterioration  in  lateral  performance 
(conf 3.  3  and  9)  of  about  100  The  model  predicts  that  the  effect  of  the 
texture  (conf.  10)  on  system  performance  is  negligible. 

The  effect  of  the  model  parameter  variations  (thresholds  and  overall 
attention)  on  the  system  scores  and  additional  theoretical  results  wij.^  be 
discussed  in  the  next  chapter  where  the  model  predictions  will  be  compared 
with  the  experiniental  results. 


EXPERIMZIITS 


The  first  objective  of  the  experimental  program  was  to  ^est  the  fore- 
croing  model  results  with  respect  to  both  the^ fund^ental  hypotheses  involved 
(optimality  in  control  and  attention  allocation,  interference  cetween  cues) 
and  the  assumed  niomerical  values  of  the  key  model  parameters.  Secondly,  in 
case  significant  discrepancy  occurs  between  model  and  experimental  results 
approcriate  adjustments  can  (hopefully)  ce  made  in  the  mciei  assumptions 
underlying  the  model  results. 

Experimental  procedures 


The  same  10  configurations  as  discussed  previously  are  investigated  in 
one  experimental  program.  These  conf igui’at ions  were  :our  times  presenteu  to 
the  (four)  subjects  (general  aviation  pilots)  in  a  random  oner,  i^ach  run 
lasted  200  sec.  Between  the  runs  the  subjects  were  asked  to  give^their 
impression  of  the  exerted  workload  (Heferenoe  9  contains  the  rating  scales 
used  and  additional  experimental  details).  The  subjects  were  instructed  to 
minimise  the  me  an- squared  system  output.  ..r.ey  were  ..rao-iied  c—  ^.ne  oen 
configurations  in  a  random  order  till  a  relatively  stable  performance  level 
was  reached.  All  together,  about  250  training  trials  were  performed. 

An  analog  computer  was  used  to  simulate  the  veniclt?  dynamics  and  uO 
generate  the  visual  scene  characteristics.  This  visual  scene  was  presented  to 
the  subjects  on  a  TV  monitor  located  2.5  m  in  front  of  their  point  of  regard. 
They  manipulated  a  two— axis  isometric  hand  control,  ihe  SjSotr^  parameoers 
were  recorded  on  FM  magnetic  tape  for  off-line  mean-squared  scores  and 
frequency  domain  computations  . 


Comparison  of  experimental  results  and  model  scores 


In  this  section  the  experimental  results  in  terms  of  me; 
^^^•pormance  scores  are  compared  w'ith  the  model  pred.i.Ck^ivjns  •  . 
results  of  table  2  firstly  the  approach  angle  (a)-  and  cente: 
(cj  )  scores  are  considered  (the  model  predicts  attitude-  and 
wh^ch  arc  rclativelv  insensitive  over  the  conf iguraticiis ) . 


n-squared 
ased  on  the 
Tine  inclination 
control  scores 


Unfortunately,  these  frequency  domain  data  were  not  available  in  time  to 
include  in  this  paper.  These  results  will  be  included  in  reference  ?. 


Apart  from  the  nominal  model  predictions 

uncertainty  in  underlying  assuriDtions  1  ^  tablets )  the  effect  of  the 
holds  and  overall  attention)  numerical  values  of  the  thres- 

upper-  and  lover  threshold  value^giyen'^'S  SS'"? 

and  -2  dB  variation  in  overall  at'^'entinn  >  in  addition,  +  2  iB 

dote^ined.  It  is  hypoSsiSd'^hTt  re.“SinKS''!cS:s°r 
tne  resulting  performance  interval.  ‘  -cores  lie  vithir. 

(or 

0^:  sr;srSo=“s  fr  ---  s^^sRitss 

valoe  rss  tde  tdrssdolds  .,d  JverRiRR-tRrRrtl-rS  rR:R., 


For  the  dual-axis  tasks  the  experime.atal  -esults  io  r.’..o  i 
i-ne  mcael  predictions.  The  exoerimertal  da‘n  c^ejirly  not  match 

been  pooled  because  both  the  model  pr-di^.io-s  ^ 

fcr  bcth  config-orations  indicate  that  t^r^nly  S^ec"  o' 
information  is  the  enhancement  of  the  perspective  illu-ic-* 

-...parent  during  the  learning  phase.  An  adrLtr-.  of  -fl';-'? 
values  (which  has  to  be  appropriate  for  the  singil^’' ~ Parameter 

lit  ^  _ _ _ _ _  ..-i,  .  tasks  as  well)  aoes 


—  w V./JOX  xaoc 

.^iOt  result  in  a  good  agreement  with 


tlie 


experimental  scores.  Therefor- 

H  lit.-..  .-,4- U _ _•  _  -  •  ^  ' 


IS  tentatively  concluded  that  the  assumed  ^  •  - » 

the  two  tasks  has  to  be  rejected.  Instead  ’Vl'foi^n  -f-^'^^^erence  betve- 
considered:  the  visual  seen-  sti-ula^e-  t’e  ^^Tpothesis  is 

dual-axis  task  just  as  veil  as  the  Jil^l--lx"’fJa  the 

*3  not  uegraded  when  the  lateral  control  tas.^is  ’  vertical  control 


_  men  tnat  tl-iere  is  no  performance  i.nterferenor 
iscussod  in  the  following.  - - - -  «-renc . 


TUi' 


loe  v'ersa/.  !'c. 


h:is  will  be  f'j 


Cc.....aring  ai.30  the  attitude  scores  and  fn) 

P-'sdio-.ions  ir.  iatU  !  ar.d  t!,:  .“h”"® 

i  .e  measured  control  scores  are  much  lover  than  ^^-Ir ^  scores  and 
.nat  .ne  sUDjects  .being  pilots)  oerformed  the  -‘to  1-1  : 

appearing  -  "apprcach"  tasks  in  a  much  smocthe>-  fashlo^-hl  1, 
predicts  on  the  basis  of  an  assumed  neuromotcr  time  col c'T" 

*-  ccnf.:^ed  -y  pi_ot  commentary  i.ndicating  th«^  i-.-X"''  *  .;. 

^‘°^:^-'^nts  a.nd  "chase  the  neeblsh'^*’^ 
un  uhis  observation  the  neuremetor  tine  cons^a-^t  --c:  '•  ^  ^ 

va.ue  oi  0.25  sec.  This  value  which  was  kepu  con^!ll  inM  ^ 

a..alysiS  13  apparently  more  represe.ntative  for  ou*“r-l nr-. 
in  addition,  figure  5  suggests  that  for  the\-ertill'co-'m^°t  behavior, 
agreement  between  measured  and  model  results  will  be  ^  cetter 

tnreshold  values  given  in  table  2  will  be  ass^m^d  (S  °  «en  the  love: 

IS  tne  only  minor  adjustment  of  the  model  variables.’^ 

ihe  resulting  model  scores  are  comcarnd  wirv-,  r'-e. 
values  in  table  3.  In  general,  the  agre^merl.  -'nean-squared 

tn,  r_efir.M  =ojy  score,  is  .-ciso  geo.;.  ,i„v  (v.JhT  .oRI-oTTTrf'';  h‘i 

-  i-  e  con  r-o.  cocores  match,  on  the  average,  very  well.  The'soane  cH-t' 
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said  of  the  system  Jhowrtha?'the  pilots  were  somewhat 

A  comparison  pitch  corrections  than  the  model  predicts  (apart 

ss  rrrraSon  o.  -“aSr^rdSul^^ed^^  rhS^re^r: 

r.n";rr=rriS 

match  again,  rather  well  t 

+  on+-ii*  scores  are  summarized  in  figure  7-  For  the  dual-axis 
The  system  corresponding  with  the  assumption  that  there 

configurations,  botn  the  ^cor  t  "full  interference 

,.o  performance  interference  . 

;r;riS:rSS:fe  =;«,:«  tS';;rt;calf  -and  ii-„ral  ani.  tnanxa  to  the 


visual  scene. 

T  relatively  realistic,  outer- 

In  summary,  it  can  be  .  Tnei-cictor  time  constant  of  (say) 

loo?  control  tasks  -^aer  „ij,or  adjustment  of  the 

0.25  sec  IS  approp  ;  ‘  requ^'red  to  yield,  cn  the  average,  a  good 

nominal  moael  variacles  wuo  r^qu-  ^  ^  position  threshold  for  a 

agreement  between  f ^^J^\;,.^sv.oiyfcr  d  and  ©  of  0.2°/sec  (the  same  _ 
and  ^  of  0.4  and  u  exoerimental  results  providea 

value  as  “  74“”“,  ujpoiheiis  that  the  visual  scene  perception  ^ 

“o"rs'rrdra=nhedl.|e  hasis  of  the 

iSfrSL::rulrStrr:”tl^  tont-  --  -  'terfo»ed 

iaimulcaueously . 

workload  model  results  and  subjective  ratings  . 

•  for-.c-oi-nv  model  r-sults  human  cterator  workload  can  be  computed. 
Using  tne  Foregoing  ni^c-sse-  ’n  reference  o)  involves  not  only  the 

:°ff1"?erucr  'o7’dedIc;t;dt.;  the  tash  in  accordance  uith  the  r.odel 
iTVjfnlol  n,  hl'Slso  the  aspect  of  arousal  ( "unoertair.ty  ,. 

The  “Idi  ”  r°e??enc,)“6'’Sf  o.“apS  ^rorSrngSanoh 

on  the  workload  scaie^g  su-ie''t-’’ve  -a'-’ngs  and  workload  model 

1  the  linear  correlation  be.. e-n  *  provides  additional 

predictions  is  quite  good  vr  -  O.b.) . -  P 

sucrort  for  the  workload  model. 


T'ne  work. 


esult  provides  additional 


The  model  predicts  a  much  lower  work 
reflected  by  the  subjective  ratings.  The 
this  configuration  the  subjects  were 
vertical  position  was.  Not  only  tr.ey  ly-ni 
f=;cmewhat* discouraged  by  their  varying 


(somewhat  qiscouragcu  ,  • 

clearly  did  not  like  the  uncertain: 
can  also  be  related  to  training. 
p.gr-.pot-  nredicts  that  the  work..oad  -or. 


ivei  for  configuration  1  than 
it ion  for  this  is  that  for 
.at  the  right  (nominal)^ 

:vly  on  this  configuration 
-.-r romance)  "but  also  they 
rerfoming  the  task  vhich 
..ot  including  this  learning 
with  this  configuration  will 


^  ^or  the  roll— only  tas.t  (conf .  i  / 
-i5  dB  had  to  be  assumed  in  cra^j: 


cvcraii  :-.fvel  of  attention,  P^,  of 
^atcii  t n w  measured  scores. 


substantially  reduce  when  the  subjects  are  r.ore  trained  on  (familiar  with) 
this  tas>. 


CONCLUSIOIIS 
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isual  scene  provides  a  variety  of  perspective  geometrical  eind 
.otion  cues.  The  experimental  results  have  supported  that  tnese 
.sties  can  be  considered  as  separate  cues  among  which  the  human 
:as  to  divide  his  attention.  The  commonly  accepted  idea  that 
information  is  better  integrated  (less  interfering)  than  separate 
.ements  is  in  the  present  study  specif ically^ demonstrated  in  that 
10  performance  interference  between  the  vertical  and  laterai.^  tasx. 
rorkload  model  results  and  the  subjective  ratings  indicawe  wna-v 
lad  is  increased  indeed  when  performing  both  tasks. 


.e  case  of  guidance  control  tasks  te.g.,  the  visual  aprroacn  tas/j 
:  reluctant^to  make  rapid  control  movements.  This  is  represented 
, imal  control  model  by  a  weighting  on  contrea  rate  correopb^nain^^ 
iromotor  time  constant  of  about  0.25  sec.  This  outer-loop  contro. 
3  di st inf?uished  from  attitude  inner— loop)  control  tasks  Wi.iCi. 
*‘='lled  vith  a  neuromotor  time  constant  of  0.1  sec  (Ref.  i). 


nermore,  the  assicnptions  concerning  the  key  parameters  of  this 
i.e.  the  perceptual  thresholds,  v-ould  ( indirectly ^  be 
maiiist  the  experir.eiital  data.  Apart  from  one  minor  adjustment  the 
issumed  threshold  values  yielded  a  good  agreement  between  mcuel^ 
d  measurements.  The  sensitdvity  analysis  visualised  in  ^u-gures^^ 
icates  that  this  result  allows  a  reasonable  accurate  verification 
lerlying  model  parameters  (thresholds  and  level  of  attention). 

lly,  the  workload  model  predictions  have  teen  confirmed  convincingly 
nive  ratings.  Apart  from  configuration  1  (the  perforaance  of^vhich 
have  been  dominated  by  a  psychologigal  efiect  not  included  ^ne 
,e*  lineal*  correlation  between  model  predictions  and  subjective 
as  0 . 9 • 
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Table  2 


Model  predictions 


a)  VERTICAL  COKTRCL 
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f/*"  ( deg^ } 
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</7{deg^) 

(H^) 
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e 

attention 
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f. 

1 

1 
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C.2L2 
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f  =  0.55 

f.  =  0.-5 
a 

2 
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57.3 
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f.  =  0.- 
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0.103 

i 
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^  =  c 
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b)  LATERAL  COLT?. CL 
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LINEAR  MODELLING  OF  ATTENTIONAL  RESOURCE  ALLOCATION^ 

2 

by  Byron  Pierce  and  Christopher  D.  Wickens 
University  of  Illinois  Department  of  Psychology 


SUMMARY 


Eight  subjects  time-shared  performance  of  two  compensatory  tracking 
tasks  under  conditions  when  both  were  of  constant  difficulty,  and  when  the 
control  order  of  one  cask  (designated  primary)  was  varied  over  time  within 
a  trial.  On  line  performance  feedback  was  presented  on  half  of  the  trials. 
The  data  are  interpreted  in  terms  of  a  linear  model  of  the  operator's  atten¬ 
tion  allocation  system,  and  suggest  that  this  allocation  is  strongly  subop- 
timal.  Furthermore  the  limitations  in  reallocating  attentional  resources  be¬ 
tween  casks,  in  response  to  difficulty  fluctuations  were  not  reduced  by  aug¬ 
mented  performance  feedback.  Some  characteristics  of  the  allocation  system 
are  described,  and  reasons  for  its  limitations  suggested. 


INTRODUCTION 


A  common  requirement  imposed  upon  the  human  operator  engaged  in  time¬ 
sharing  performance  under  time-varying  environmental  conditions  results  when 
changes  occur  In  the  difficulty  of  one  of  two  concurrently  performed  Casks, 
as  its  performance  constraints  are  held  constant.  Such  changes  thereby  force 
a  reallocation  of  attentional  resources  toward  the  task  whose  difficulty  is 
increasing.  Thus  for  example  in  precision  flight,  an  Increase  in  lateral  air 
turbulence  will  require  re-allocation  of  resources  away  from  tasks  of  lesser 
demand  (communications,  pitch  control)  toward  control  along  the  lateral  cxis. 


The  entire  process  of  task  demand  evaluauion  and  resource  allocation 
can  be  conceptualized  as  a  two  stage  process.  The  opf rator  must  first  eval¬ 
uate  the  error,  or  discrepancy  between  desired  and  actual  performance  on 
the  task  or  tasks  required  (error  evaluation).  If  such  an  error  is  per¬ 
ceived  to  exist,  the  attention  allocation  system  then  must  respond  by  shift¬ 
ing  resources  in  a  taanner  to  restore  the  desired  level  of  performance  and 
nullify  the  original  error  (resource  allocation).  This  closed  feedback  loop 
describing  the  resource  allocation  system  is  analogous  in  some  respects  to  a 
compensatory  tracking  task,  in  which  position  error  is  evaluated  and  a  manual 
control  response  is  executed  to  nullify  the  error.  Because  of  this  similar¬ 
ity,  modelling  techniques  borrowed  from  manual  control  will  be  utilized  in 
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fic  Research  Life  Sciences  directorate,  AF0SR77-3380.  Dr.  Alfred 
Fregly  was  the  contract  monitor. 


^Now  at  Williams  Air  Force  Base, 


blahk 


the  current  investigation  to  describe  and  evaluate  the  human's  attention 
allocation  system. 

Delp  and  Crossman  (Reference  1)  have  provided  an  analytical  framework 
for  describing  the  linear  relation  between  time-varying  task  parameters  and 
single  task  performance  in  terms  of  a  higher  level  **meta  transfer  function." 
The  objective  of  the  present  research  is  to  apply  similar  procedures  to  anal¬ 
yze  the  meta  transfer  function  of  the  resource  allocation  system  to  task  de¬ 
mand  (difficulty)  changes  in  the  dual  task  environment.  In  the  paradigm  em¬ 
ployed,  subjects  perform  two  concurrent  tracking  tasks.  One  task  is  desig¬ 
nated  as  primary--a  high  priority  task  whose  performance  is  to  be  maintained 
at  or  above  some  criterion  for  the  duration  of  a  trial.  During  the  trial, 
the  difficulty  of  the  primary  task  is  varied  in  a  semi-periodic  fashion.  It 
is  assumed  that,  to  the  extent  that  he  is  capable,  the  subject  follows  the 
priority  instructions,  and  primary  task  performance  remains  constant  in  the 
face  of  varying  primary  task  difficulty.  To  achieve  this  optimal  allocation 
behavior,  the  subject  is  therefore  required  to  withdraw  processing  resources 
from  performance  of  the  secondary  task,  and  its  performance  should  then  vary, 
more  or  less  phase-locked  to  the  difficulty  variations  of  the  primary  task. 

An  hypothetical  example  of  this  "optimum  allocation  response"  to  a 
ramp  increase  in  primary  task  difficulty  is  depicted  by  the  solid  lines  of 
Figure  1.  The  time-varying  performance  on  both  tasks  is  portrayed,  along 
with  the  inferred  allocation  of  processing  resources  between  the  tasks. 

Note  the  differential  sensitivity  of  primary  vs.  secondary  task  performance 
to  the  increase  in  primary  task  difficulty,  and  the  corresponding  optimum 
allocation  of  resources.  Naturally,  other  varieties  of  allocation  responses 
may  be  observed  as  well.  The  dashed  lines  in  Figure  1  depict  that  of  a  non¬ 
optimum  allocator  in  which  resources  are  not  at  all  redistributed,  and  pri¬ 
mary  task  performance  varies  with  its  difficulty.  Naturally  a  hybrid  response 
between  that  of  the  optimal  and  nonoptimal  allocator  is  possible,  in  which 
there  is  some  reallocation  of  resources,  but  in  insufficient  degree  to  meet 
the  new  primary  task  demands. 

The  model  that  will  be  employed  to  describe  the  allocation  system  is 
portrayed  in  Figure  2.  Here  the  allocation  system  is  assumed  to  be  a  linear 
dynamic  system  in  the  sense  that  it  receives  inputs  (task  demands  and  sub¬ 
jectively  assessed  performance)  and  generates  outputs  in  response  (mobilized 
processing  resources).  While  these  outputs  cannot  be  directly  observed,  they 
may  be  inferred  from  an  appropriately  filtered  on-line  performance  measure. 
Thus  in  dual  cask  performance,  depicted  in  Figure  2,  the  dynamic  relation 
between  the  four  inputs  to  the  allocation  system  (difficulty  and  performance 
demands  on  both  tasks)  and  the  two  outputs  (task  performance  on  each  task) 
can  be  evaluated  to  determine  the  extent  to  which  these  are  described  by  a 
linear  transfer  function  or  orderly  mathematical  relation.  Such  a  procedure 
is  analogous  to  the  analysis  of  dual  axis  tracking  (Reference  2). 

When  analyzing  dual  task  performance,  one  may  examine  for  each  task,  the  - 
sensitivity  of  its  allocated  resources  (inferred  from  performance)  to  changes 
in  its  own  difficulty  ^2^2  Figure  2)  and  to  changes  in  the  dif¬ 

ficulty  or  performance  or  the  concurrent  task 


TI.':. 


Figure  I.  Hypothetical  response  depicting  optimal  allocation  adjust* 
ment  (solid  lines)  and  nonoptimal  allocation  (dashed  lines) 


Figure  2.  Schematic  representation  of  dual  task  performance 


current  study  Fourier  analysis  will  be  employed  to  determine  the  relations  be¬ 
tween  time-varying  inputs  (tracking  task  difficulty)  and  time-varying  outputs 
(filtered  performance).  To  the  extent  that  the  resource  allocation  system 
is  sensitive  at  all  to  these  variations^  the  linear  coherence  measure,  cor¬ 
relating  variations  over  time  between  the  input  and  output  signals,  should 
be  non-zero.  More  specifically  the  cross-channel  (D.P^  and  )  and  like- 
channel  ^2^2^  coherence  measure  will  be  examined  as^a^means  of 

determining  the  optimality  of  the  allocation  system.  For  a  highly  optimal 
system,  the  like  channel  coherence  should  be  a  low  (near  0),  with  the 

crosschannel  coherence  (I>j^P2^  (near  1,0).  For  the  non-optlmal  allocator 

the  values  should  be  reversed,  and  for  the  hybrid  case  both  coherence  values 
should  be  relatively  high. 
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If  suboptixnal  allocation  is  observed  in  the  present  results,  then  an 
important  question  that  can  be  asked  relates  to  the  source  of  the  limita¬ 
tion  in  the  allocation  system.  In  terms  of  the  two-phase  description  of  the 
allocation  process  as  shown  in  Figure  2,  one  may  ask  whether  the  limitation 
results  from  the  operator's  inability  to  perceive  discrepancies  between 
desired  and  actual  performance  (failure  of  error  evaluation),  or  from  the 
inability  to  reallocate  resources  in  response  to  an  accurately  evaluated 
erro.  .  In  an  analogous  manner  it  is  possible  to  ask  whether  inadequate  per¬ 
formance  in  a  compensatory  tracking  task  results  from  poor  perceptual  eval¬ 
uation  of  the  displayed  error,  or  frcm  an  inability  to  execute  an  appropriate 
control  response. 

To  investigate  the  source  of  potential  limitations,  a  separate  set  of 
experimental  conditions  were  included  in  which  the  conventional  instan¬ 
taneous  tracking  error  display  was  supplemented  by  augmented  performance 
feedback  that  displays  the  discrepancy  between  the  desired  level  of  primary 
task  performance,  and  the  running  average  of  that  perfonnance  (e.g..  Reference 
3).  To  the  extent  that  limitations  in  the  allocation  system  result  from 
inadequate  error  evaluation,  rather  than  limits  of  allocation,  then  the  ex¬ 
plicit  display  of  the  discrepancies  in  performance  should  produce  a  corres¬ 
ponding  approach  Coward  optimality  of  allocation  (i.e.,  an  increase  in  the 
cross -channel,  and  decrease  in  the  like-channel  coherence). 


METHCM) 


Tasks.  Subjects  performed  two  compensatory  tracking  tasks,  displayed 
one  above  the  other  with  a  slight  horizontal  offset.  The  left  display  was 
controlled  by  left-right  manipulation  of  a  spring  loaded  controller  held  in 
the  left  hand.  The  right  display  was  similarly  controlled  with  the  right 
hand.  The  total  visual  angle  subtended  by  both  displays  was  4®  (horizontal) 

X  1®  (vertical).  Disturbance  inputs  consisted  of  band-limited  white  noise 
with  an  upper  cutoff  frequency  of  .32  Hz.  Separate  uncorrelated  disturbances 
were  employed  on  each  task  and  were  added  to  the  output  of  the  control  dynam¬ 
ics.  Control  dynamics  were  of  the  form: 


On  trials  of  constant  difficulty,  the  value  of  the  difficulty  parameter 
alpha  was  set  at  .50.  On  variable  difficulty  trials,  the  value  of  alpha  on 
one  task,  designated  primary,  was  driven  by  the  function:  a  *  .50  +  Sin 
(.1884  t)  +  Sin  (.0628  t),  (0  <  a  <  1).  This  produced  a  system  that  var¬ 
ied  continuously  between  second  order  unstable  dynamics,  first  order  stable 
dynamics,  and  intermediate  levels  in  a  series  of  spikes  and  ramps  (see 
Figures  3  and  4).  Secondary  task  difficulty  was  always  held  constant  with 
alpha  ■  .50. 

Supplementary  performance  feedback  of  the  primary  task,  used  in  variable 
difficulty  trials,  appeared  as  a  oar  graph  varying  in  height  to  reflect 
changes  in  performance  (Reference  3).  The  performance  bar  represented  in- 
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cegraced  primary  task  error,  averaged  over  a  sliding  5-second  window.  The 
desired  performance  level,  indicated  by  a  short  horizontal  line  positioned 
about  half  the  distance  from  the  zero  point  (no  bar  graph  showing)  to  the 
top  of  the  display,  reflected  the  subject's  average  performance  assessed  for 
trials  of  constant  difficulty.  By  tracking  so  that  the  bar  graph  remained  at 
or  above  the  desired  performance  line,  the  subject  attained  desired  standards 
of  primary  task  performance. 

Root  mean  squared  error  (RMSE)  was  computed  on  line  for  each  task  and 
recorded  at  the  end  of  each  trial.  Control  stick  and  cursor  error  posi¬ 
tions  were  sampled  and  recorded  on  tape  every  120  msec.  Experimental  control 
was  governed  by  a  Raytheon  704  computer. 

Design  and  Procedure.  Eight  right-handed  male  students  at  the  Univer¬ 
sity  of  Illinois  participated  in  the  experiment  and  were  paid  for  participa¬ 
tion.  A  within-subjects  design  was  employed  so  that  all  subjects  performed 
all  experimental  conditions.  Following  one  day's  session  of  practice  on  the 
dual  axis  tracking  tasks,  four  experimental  sessions  were  conducted.  Within 

s^3gion,  subjects  performed  24  two  minute  dual  task  trials,  xhese  con¬ 
sisted  of  3  trials  of  constant  difficulty,  of  which  the  final  4  were  used 
for  data  analysis  (Phase  I),  followed  by  12  trials  of  variable  difficulty,  of 
which  the  final  8  were  used  for  data  analysis  (Phase  2).  Finally  the  subjects 
received  four  more  trials  of  constant  difficulty  (Phase  3).  During  constant 
difficulty  trials  subjects  were  instructed  that  the  two  tasks  were  of  equal 
priority,  while  in  Phase  2,  the  task  of  variable  difficulty  was  designated 
as  primary--its  performance  to  be  held  constant.  On  alternating  Phase  2 
trials,  either  the  left  hand  task  or  the  right  hand  task  was  primary  (and  was 
therefore  variable).  Similarly  on  alternating  pairs  of  Phase  2  trials,  sup¬ 
plemental  feedback  was  either  present  or  absent. 


RESULTS 


RMS  Error.  Two  1-way  repeated  measure  analyses  of  variance  were  per- 
fonned  on  the  R.MS  tracking  errors,  one  for  primary  and  one  for  seconda.-y  task 
performance.  The  four  levels  of  each  ANOVA  consisted  of  Phase  1,  Phase  2 
feedback,  Phase  2  no-feedback,  and  Phase  3,  The  effect  of  condition  on  the 
performance  measures  in  both  ANOVAs  was  highly  reliable  (Primary  Task, 

F  ,,  =•  107.98,  p  <  .001;  Secondary  Task,  F^  =  34.93,  p  <  .001).  The 
mein  values  of  primary  and  secondary  task  ertor  for  the  four  conditions 
are  shown  in  Table  1.  It  is  apparent  that  large  differences  in  both  tasks 


Primary  Task 
Secondary  Task 


Table  1: 

RMS  Error  (Proportion 

of  Scale 

Phase  I 

Phase  2  Feedback  Phase 

2  No  Feedback 

Phase  3 

.1164 

.1808 

.1869 

.1166 

.1206 

.2058 

.1806 

.1147 

were  evident  between  the  variable  (Phase  2)  and  constant  difficulty  (Phases  I 
and  3)  trials,  a  difference  substantiated  by  the  experimental  contrast  of 
Phase  1  with  Phase  3  no-feedback  (Primary  Task,  F,  _  •  153.0,  p  <  .001;  Sec¬ 
ondary  Task,  y  =>  31.8,  p  <  .001).  The  effect  of 'feedback,  however,  exam¬ 
ined  in  the  contrast  between  the  two  Phase  2  conditions,  was  only  reliable 
for  the  Secondary  Task  (F,  _  -  59.03,  p  <  .001). 

Coherence  Analysis.  The  response  of  performance  to  the  time-varying 
changes  in  task  difficulty  is  Illustrated  in  Figures  3  (feedback)  and  4 
(no-feedback).  The  error  measures  were  smoothed  by  averaging  tracking  RMS 
within  a  sliding  2.4  second  window.  These  smoothed  performance  re¬ 
cords  were  then  ensembled  over  trials  and  subjects  to  produce  the  data  por¬ 
trayed  in  Figures  3  and  4.  It  is  evident  in  these  figures  that  to  some  ex¬ 
tent  performance  on  both  tasks  "tracked”  the  time-varying  difficulty  para¬ 
meter,  an  observation  that  was  bom  out  by  the  analysis  of  linear  coherence. 

The  linear  coherence  analysis  employed  a  Fast  Fourier  Transform  algor¬ 
ithm  (Reference  4)  to  transform  time  variations  of  primary  task  alpha  and 
within  trial  error  measures  to  power  spectra  in  the  frequency  domain.  From 
these  transformed  measures,  linear  coherence  values  (Reference  5)  were  com¬ 
puted  correlating  variations  over  time  between  Primary  Task  difficulty  (alpha 
level)  and  the  performance  measures  (within  trial  error  averages)  on  both 
tasks. 


Obtained  linear  coherence  values,  assessed  at  the  six  lowest  frequency 
values  that  best  account  for  variations  of  the  task  one  alpha  signal,  are 
displayed  in  Figure  5.  It  is  evident  in  Figure  5  that  linear  coherence  is 
reasonably  high  in  both  conditions  for  both  measures.  Hovever,  primary  task 
difficulty  fluctuations  seem  to  induce  greater  variation  in  primary  task  than 
in  secondary  task  performance.  Similarly  feedback  demonstrated  little  ef¬ 
fect  on  primary  task  coherence  but  a  small  but  consistent  effect  on  the  co¬ 
herence  with  the  secondary  task. 


DISCUSSION 


The  most  striking  aspect  of  the  data  relates  to  the  marked  deteriora¬ 
tion  in  performance  on  both  tasks  that  results  when  the  difficulty  of  one  is 
made  variable.  This  was  manifest  in  a  6O-70X  increase  in  RMS  error,  despite 
the  fact  that  the  average  value  of  the  difficulty  parameter  alpha  (*  ,50) 
in  the  variable  difficulty  tasks  was  equivalent  to  its  value  in  the  constant 
condition. 

A  reasonable  explanation  for  this  difference  can  attribute  the  perfor¬ 
mance  decrement  to  the  higher  level  cognitive  process  required  to  deal  with 
varying  task  demands,  in  an  effort  to  meet  performance  requirements.  In 
short,  the  operation  of  the  attention  allocation  system  itself  requires 
processing  resources  in  order  to  function  in  continuously  reevaluating  and 
responding  Co  resource  demand  changes. 
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Figure  3. 


Figure 
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Average  time  history  of  within  trial  dual  task  error 


Average  time  history  of  within  trial  dual  tasic  error  and 
primary  task  alpha— no-feedback  condition 
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Figure  5.  Linear  coherence  values  Figure  6-.-  Gain  plot  of  transfer"  •* 
between  alpha  and  track-  function.  Ratio  of  track" 

Ing  error  measures  Ing  error  (range  0-1.0) 

to  altha. 


Properties  of  the  Allocation  System.  The  proposition  that  the  system 
may  be  modelled  approximately  as  a  linear  dynamic  system  received  some  sup¬ 
port  in  the  current  results,  both  from  the  relatively  high  linear  coherence 
values  obtained  at  the  frequencies  corresponding  to  difficulty  variation, 
and  on  the  basis  of  visual  examination  of  Figures  3  and  4.  In  addition  to 
the  general  responsiveness  of  performance  on  both  tasks  to  the  difficulty 
fluctuations  described  above,  two  additional  characteristics  of  these  fig¬ 
ures  that  are  not  revealed  by  the  coherence  analysis  are  particularly  rele¬ 
vant. 


1.  The  transfer  function  of  the  alpha-performance  data  was  computed, 
and  the  amplitude  ratio  data  are  plotted  in  the  gain  portion  of  Che  Bode  plot 
shown  in  Figure  6.  While  the  linear  correlation  of  this  slope  is  not  high, 
and  the  number  of  points  (6)  is  too  few  to  allow  any  strong  conclusions,  the 
implication  of  these  data  is  that  the  response  of  the  aliocation  system,  as 
Inferred  from  subjects'  performance  is  to  lead  the  difficulty  variation  as  a 
KS  system.  That  is,  performance  is  sensitive  to  the  rate  of  change  or  first 
derivative  of  difficulty,  rather  than  to  the  absolute  level  of  difficulty 
itself.  This  behavior  is  graphically  illustrated  in  the  response  of  primary 
raslc  performance  to  the  spike  increase  in  alpha  at  time  t  ■  72  in  Figures  3 
and  4,  This  result  is  in  contrast  to  that  observed  by  Delp  and  Crossmaa  _ 
(Reference  1),  who  modelled  the  performance  response  to  difficulty  changes 
(their  '•meta"-transfer  function)  as  a  first  order,  K/S,  or  integral  system. 
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The  source  of  this  difference  is  not  immediately  apparent;  it  may  be  attribu¬ 
table  to  either  the  repeated  nature  of  the  difficulty  function  employed  in 
the  current  study  that  allowed  the  subjects  some  degree  of  anticipation^  to 
the  discrete  steplike  changes  of  that  function,  or  to  the  dual  task  environ¬ 
ment  used  here* 

2.  Both  figures  indicate  the  presence  of  relatively  high  frequency 
oscillations  in  secondary  task  performance  that  do  not  correspond  to  varia¬ 
tions  in  alpha.  While  these  oscillations  might  at  first  be  described  as 
"noise,**  it  should  be  noted  that  they  correspond  very  closely,  point- for- 
point  in  time  between  the  separate  and  independent  replications  depicted  in 
Figures  3  and  4.  A  close  correspondance  of  this  nature  would  not  be  pre¬ 
dicted  from  random  variability  in  the  two  replications.  Instead,  these  os¬ 
cillations  bear  a  resemblance  to  the  frequency  response  that  a  second  order 
physical  system  with  spring  loading  might  show  to  c  step  or  impulse  input, 
approximating  the  nature  of  the  difficulty  changes  presently  employed. 

While  the  precise  nature  or  source  of  these  oscillations  cannot  be  estab¬ 
lished,  their  presence  nevertheless  provides  supportive  evidence  for  the 
linearity,  and  invariant  properties  of  the  allocation  mechanism,  and  en¬ 
courages  further  investigation. 

Optimality  of  the  Allocation  System,  The  coherence  analysis  performed 
indicated  clearly  that  subjects  did  not  behave  as  the  optimum  allocator  of 
Figure  1,  In  marked  contrast  to  the  instructions  delivered  to  the  subjects, 
primary  task  performance  was  highly  sensitive  to  primary  task  difficulty. 

It  is  therefore  important  to  ask  why,  in  the  present  results,  subjects  ap¬ 
peared  unable  to  follow  the  imposed  priority  instructions,  Wlckens  and 
Kessel  (Reference  6}  showed  that  when  the  difficulty  of  a  task  (instability 
tracking)  is  increased  between  sessions  in  a  dual  task  environment,  it  is 
possible  for  subjects  to  hold  that  task  performance  constant--at  the  ex¬ 
pense  of  secondary  task  performance.  Why  then,  when  difficulty  was  manipu¬ 
lated  within  a  session  in  the  current  experiment,  was  the  severe  limitation 
observed? 

It  appears  unlikely  that  subjects  simply  ignored  the  instructions,  as 
resources  clearly  were  withdrawn  from  the  secondary  task  to  deal  with  the 
difficulty  increase  and  were  returned  when  demands  were  lowered,  thus  pro¬ 
ducing  the  high  secondary  task  coherence  measure.  Instead  it  appeared  that 
either  the  resources  withdrawn  were  not  delivered  to  the  primary  task,  or 
alternatively  that  the  changes  in  difficulty  were  sufficiently  abrupt  that 
smooth  resource  modulation  could  not  occur  (i,e.,  resource  adjustment  did  not 
have  sufficient  time  to  operate).  This  second  hypothesis  is  supported  by 
visual  inspection  of  Figure  3,  Note  following  the  difficulty  step  increases 
at  times  t  ■  24-28  and  t  =  96  seconds  that  in  both  Instances  primary  task 
error  begins  gradually  to  reduce  as  secondary  task  error  undergoes  a  corres¬ 
ponding  increase,  as  if  at  this  point  the  subject  begins  a  gradual  and  ap¬ 
propriate  reallocation  of  processing  resources  away  from  the  secondary  task 
toward  the  primary,  in  accordance  with  instructions.  In  fact  a  rough  esti¬ 
mate  of  the  lag  between  difficulty  increases  and  secondary  task  error  in¬ 
creases  places  this  lag  at  approximately  2-3  seconds,  a  value  that  corres¬ 
ponds  reasonably  well  to  the  2,8  second  lag  observed  by  Delp  and  Crossman, 


The  impllcacioa  of  this  observation  is  that  the  appropriate  resource  mobil* 
ization  might  be  within  the  capabilities  of  the  operator  to  a  greater  extent, 
had  the  difficulty  transitions  been  of  the  more  gradual  nature  employed  by 
Delp  and  Crossman, 

Feedback,  The  contrast  in  performance  measures  between  the  augmented 
feedback  and  no- feedback  conditions  indicated  further  that  the  operator's 
limits  were  manifest  in  the  second  stage  of  the  closed  loop  allocation  sys¬ 
tem— the  reallocation  of  resources— rather  than  in  the  first  stage— the  er¬ 
ror  evaluation  process.  When  this  evaluation  process  was  presumably  aided  by 
explicit  presentation  of  the  discrepancy  between  desired  and  obtained  per¬ 
formance,  no  reliable  improvement  in  allocation  behavior  was  observed,  either 
in  the  form  of  a  reduction  of  primary  task  error,  or  a  reduction  in  its  lin¬ 
ear  coherence  function  with  alpha.  In  fact,  the  only  effect  of  feedback 
that  was  observed  was  a  reliable  increase  in  secondary  task  error,  and  a 
corresponding  Increase  in  the  secondary  task  coherence  measure,  as  this 
task  apparently  became  more  responsive  to  the  changes  in  primary  task  dif¬ 
ficulty. 

While  augmented  feedback  did  not  prove  to  be  useful  in  the  current 
investigation,  the  conclusion  drawn  must  of  necessity  be  limited.  It  is 
quite  likely  that  the  difficulty  changes  were  sufficiently  dramatic  that 
their  presence,  and  the  resulting  performance  changes,  were  easily  observa¬ 
ble  by  the  subjects.  Changes  of  a  more  subtle  nature  might  have  produced 
a  sub-threshold  deterioration  in  performance  that  could  only  be  detected 
with  the  aid  of  the  augmented  feedback. 


CONCLUSION 


The  major  limitations  of  human  performance  in  the  variable  difficulty 
paradigm,  demonstrated  in  the  present  results,  suggest  that  this  area  war¬ 
rants  further  exploration.  Research  is  needed  to  determine  the  effect  on 
allocation  ability  of  such  variables  as  training,  the  nature  of  the  diffi¬ 
culty  time  functions,  and  the  qtialitative  similarity  between  the  time- 
shared  tasks.  Through  this  research  a  better  appreciation  can  be  gained 
not  only  of  the  mechanism  by  which  attentional  resources  are  allocated,  but 
of  the  fundamental  nature  of  those  resources  themselves, 
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A  MODEL  FOR  DYNAMIC  ALLOCATION  OF  HUMAN  ATTENTION 
AMONG  MULTIPLE  TASKS 
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Man-Machine  Systems  Laboratory 
Department  of  Mechanical  Engineering 
Massachusetts  Institute  of  Technology 
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Abstract 

This  paper  consists  of  two  parts.  The  first  part  describes  the 
problem  of  multi-task  attention  allocation  with  special  reference  to 
aircraft  piloting,  the  experimental  paradigm  we  use  to  characterize 
this  situation  and  the  experimental  results  obtained  in  the  first 
phase  of  our  research.  A  qualitative  description  of  an  approach  to 
mathematical  modeling,  and  some  results  obtained  with  it  are  also 
presented  to  indicate  what  aspects  of  the  model  are  most  promising. 

The  second  part  of  the  paper  consists  of  two  appendices  which  (1)  dis¬ 
cuss  the  model  in  relation  to  graph  theory  and  optimization  and  (2)  sped 
fy  the  optimization  algorithm  of  the  model. 


1,  Introduction 

We  think  that  an  increasingly  crucial  aspect  of  piloting  an  air— 
craft  is  "multi-task  allocation  of  attention".  The  pilot  must  monitor 
many  more  systems  than  before,  most  of  which  are  growing  in  complexity. 

In  earlier  days  flying  the  aircraft  "by  the  seat  of  the  pants"  was 
difficult,  but  piloting  was,  more  or  less,  a  constant  task.  It  was  ob¬ 
vious  that  the  pilot  could  keep  track  of  what  was  being  controlled  at 
what  time  and  how  well  that  was  working  because  he  was  doing  it;  he  was 
in  the  loop  and  could  see  or  feel  it  directly. 

As  systems  become  automatic  the  pilot  himself  tends  to  lose  track 
of  what  signals  are  coming  into  what  subsystem  and  what  response  that 
subsystem  is  making.  Most  of  the  time  when  everything  is  normal  the 
automatic  systems  do  just  fine.  Indeed  if  we  demanded  tha.t  the  £ilot 
actually  perform  all  functions  which  are  now  automated  it  is  clear  he. 
couldn't  do  a  fraction  of  such  tasks.  Yet  we  expect  him  to  monitor  all 
such  functions,  and  at  the  first  overt  alram  or  even  subtle  evidence  of 
failure  we  expect  him  to  be  able  to  render  a  quick  accurate  diagnosis  of 
the  problem  and  set  it  straight. 

We  call  the  pilot  a  "flight  manager"  or  "supervisory  controller"  and 
v/e  see  him  in  the  image  of  a  corporation  manager  with  legions  of  dutiful 
automatic  servants  doing  his  will  and  bringing  him  information  as  he  de¬ 
sires  it.  The  problem  is  that  the  corporate  manager  has  time  to  ponder 
and  investigate  and  weigh  evidence  and  consider  his  decisions.  He  operates 

_ _ _ 
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on  a  human  time  scale:  if  the  corporation  manager  sees  his  "production 
vehicle”  about  to  go  bankrupt  he  has  at  least  a  few  minutes  to  decide 
what’s  wrong  and  what  to  do  about  it.  The  flight  manager  doesn’t. 

The  general  research  questions  implied  are: 

a)  What  are  the  expected  behaviors  and  what  are  the  limits  of  a 
person’s  capability  to  allocate  his  attention  among  many  simul¬ 
taneous  tasks  of  varying  importance  and  varying  urgency,  as  a 
function  of  the  number  of  tasks,  the  general  pace  at  which  they 
occur  and  other  salient  parameters? 

b)  If  there  is  a  normative  or  optimal  way  a  person  should  perform 
such  a  task,  can  it  be  specified  as  a  quantitative  model,  and 
how  close  does  a  trained  person  come  to  behaving  optimally? 

c)  What  are  the  implications  for  improving  the  design  of  the  man- 
machine  systems  in  which  the  pilot  must  perform  such  multi-task 
allocation  decisions? 


2.  Experimental  Paradigm 

To  characterize  such  a  multi-task  decision-making  situation  we  have 
developed  a  very  general  experimental  paradigm  and  an  associated  model.  The 
experimental  paradigra  requires  the  subject  (or  decision-maker  DM)  to  select 
one  at  a  time  from  among  a  number  of  blocks  ("tasks")  of  different  heights 
and  widths  displayed  simultaneously  on  a  CRT  (Figure  1).  His  selection, 
made  by  holding  a  cursor  even  with  the  block  "attended  to"  is  in  order  to 
maximize  his  reward,  where  the  earning  rate  is  proportional  to  the  displayed 
"importance"  (indicated  by  the  height  of  each  block)  and  the  "productivity 
rate"  (the  rate  at  which  the  block  decreases  in  width  when  "attended  to"). 
Blocks  appear  at  random  distances  from  a  "deadline"  and  move  at  constant 
velocity  toward  that  deadline,  disappearing  when  they  first  touch  it.  Var¬ 
ious  task  parameters  have  to  do  with  the  frequency  at  which  new  blocks  ap¬ 
pear,  the  speed  with  which  they  move  toward  the  deadline,  the  variability 
in  importance,  the  variability  in  how  far  from  the  deadline  they  first  appear, 
and  so  on.  The  toal  is  to  "remove"  as  much  block  area  as  possible. 

In  one  experiment  blocks  continually  appear  with  exponential  dis¬ 
tribution  in  time.  In  a  second  experiment  all  blocks  appear  at  the  start 
of  the  run;  no  new  ones  appear  thereafter. 

An  important  feature  of  the  experiment  is  that  blocks  do  not  queue 
up  for  service,  i.e.,  if  a  block  reaches  the  deadline  the  opportunity  to 
earn  its  reward  is  lost.  We  cannot  say  for  sure,  however,  whether  blocks 
queue  in  the  operator’s  mind  for  attention  in  correspondence  to  the  fact 
that  at  any  one  instant  of  time  there  may  be  some  blocks  which  are  far  from 
the  deadline  and  others  which  are  close.  The  close  ones,  of  course,  may  be 
of  little  Importance,  so  often  it  is  better  to  attend  to  more  important 
tasks  which  are  farther  from  the  deadline  in  order  to  ensure  that  all  of 
the  really  importaiit  ones  do  get  attended  to  before  the  deadline. 
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Figure  2. illustrates  a  means  we  have  used  to  obtain  a  tine^plot 
of  which  block  the  subject  selects  in  which  queue  (colunn  headings) • 
Printed  symbols  in  each  column  tell  the  service  time  the  block  requires, 
the  time  the  block  will  be  available,  and  the  value  to  be  obtained* 

Having  informally  experimented  with  this  situation  with  a  variety 
of  parameter  combinations  we  are  now  in  a  position  to  claim  that  the 
experiment  does  seem  to  simulate  various  attentlonal  demands  which  are 
placed  on  the  pilot*  These  vary  considerably  in  duration*  Some  tasks 
are  urgent,  but  of  modest  Importance;  some  are  urgent  and  of  great  impor¬ 
tance;  some  are  not  urgent  and  of  modest  importance;  some  are  not  urgent 
but  of  great  importance  to  be  done  before  the  deadline. 


3.  Experimental  Results 

As  the  first  phase  of  the  second  author’s  doctoral  thesis,  experi¬ 
ments  with  human  subjects  have  been  run  with  various  experimental  para¬ 
meter  combinations.  Because  the  number  of  such  possible  combinations  Is 
so  large  we  have  investigated  the  effects  of  changing  one  parameter  at  a 
time,  relative  to  a  ’’baseline  condition”.  Table  1  indicates  that  for  all 
runs  the  subject  worked  with  3  queues  of  blocks  (tasks)  and  runs  lasted 
400  seconds.  The  baseline  parameters  are  given  above.  Seven  changes  in 
parameters  are  indicated  below,  made  one  run  at  a  time,  all  other  parameters 
matching  the  baseline  condition  in  each  case.  For  each  the  values  gained 
by  each  of  three  subjects,  the  range  of  their  data,  the  average,  and  the 
total  possible  are  given. 

In  Table  1  it  is  seen  that  a  considerably  higher  speed  of  blocks 
moving  toward  the  deadline  (2)  reduces  the  score,  but  not  much,  compared 
to  the  baseline  (1) .  Greater  variation  in  block  speed  (3)  makes  little 
difference.  A  reduction  of  interarrival  time  (A)  of  blocks  means  more 
blocks  become  available  -  more  opporunity  is  there  for  earning  a  score  - 
but  a  smaller  fraction  of  these  are  completed.  As  the  height  of  blocks 
(task  value  densities)  become  more  variable  (5)  the  net  earnings  are 
little  affected,  though  the  presence  of  a  few  very  lucrative  blocks  doubles 
the  total  possible  score.  Giving  partial  credit  (6)  for  productivity 
(allocation)  on  a  task  when  it  hits  the  deadline  Increases  the  earnings 
little  more  than  one  percent,  which  is  surprising.  Lowering  productivity 
(7)  has  the  most  significant  effect,  as  seems  intuitively  reasonable  -  but 
the  reduction  in  score  is  not  quite  in  proportion  to  the  forced  reduction 
in  rate  of  doing  tasks* 


4.  A  Mathematical  Modeling  Approach 

To  accompany  the  experimental  task,  we  have  developed  a  mathematical 
model  which  can  be  run  on  the  computer  Immediately  after  any  human  data  run. 
(The  relationship  of  the  model  to  graph  theory  la  general  and  the  full  speci¬ 
fication  of  the  model  algorithm  given  in  Appendices  1  and  2  respectively). 
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ORIGINAL  PAGE  IS 
OF  POOR  QUALITY 


COMMON  CONDITIONS 


3  queues,  400  sec  duration 


BASELINE  CONDITION 

Task  Interrival  tine,  exponential  distribution,  mean  »  20  sec/queu 

all  tasks  appear  5  units  away  from  the  deadline 

all  tasks  2.5  units  in  duration 

all  tasks  speed  toward  deadline  at  0-1  units/sec. 

productivity  on  all  tasks  0.5  units  per  sec. 

value  density  rectangular  distributor  0-1  utiles/sec 

No  partial  credit  was  given  in  the  baseline  case. 

le 

CONDITION 

Z  AVAIIABIE  VALUE  GAINED  BY  SUBJECTS  AVG. 

DY  KT  SJ  RANGE 

TOTAL  POSSIBLE 
V.ALUE  (UTILES) 

.913 

.931 

.942 

.029 

.929 

CO 

2  More  speed 

(2.5  S) 

.917 

.380 

.373 

.061 

93.7 

3  Variable  speed 

(rect,  .05-2.5) 

.934 

.907 

.912 

■ 

.913 

98.7 

4  Less  interarriv 

time  (0.7SB) 

al 

.303 

.309 

.795 

.014 

■■■ 

5  More  varied 

value  density 
(rect  dist  0-2) 

.946 

.940 

.902 

.  044 

.929 

197.6 

6  Baseline,  but 

with  partial 
credit 

.943 

.949 

.926 

.023 

.940 

98.7 

7  Less  produc¬ 

tivity  (0.5B) 

.642 

.660 

.650 

.013 

.630 

98.7 

Table  1 


Some  Experinencai  Results 
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Th€  model  Is  esseotlally  a  then  takes 

■attention  ‘“^'^retroi:,.  L  sLn  :s“.ch  nL  block  appeats  the 

the  first  step  of  repeated.  The  model  is  constrained  by 

rrre‘paj::rt^^:‘2  ::krit  h»a„-l.ke.  2TJI"s  “^.tLfnfarfata. 

re°pft™",''irrtire“riay  t!  amply  adjnated  to  natch  h»an  notot  raac- 

tion  time  plus  decision  time. 

^«r  is  a  linear  discountinj;  of  importance  of  later 
A  second  parameter  i  ___a„tories  which  the  dynamic  programming 
blocks  in  various  alternative  ^  traiectory  costs  least.  This  dis- 
algorithm  compares  to  ^in  present  evaluation  of  alter- 

count  rate  we  call  B.  Zero  S  means  that^^in^p^ 

native  htnjactorias  for  fntnra  actio  .  „ 

lJ:r'litS"  TeaS  thf^dri  5l.co/nt,  tha  fntura  co.plat.ly  and  only 
considers  alternative  next  steps. 

A  third  parameter,  IC’  ^  ^^”eranew'^at”Lch*^Lccessive  model 
(casks)  fro.  the  ^etemined  at  «ch 

jr'tirdead!!-  are’jnst  asVavlly  -ISht.a  as  th».  dose 

rdt;‘sr.ti:.-  ^trfhi:  ‘ir^irrrsfi;..  ii  m  a  >nttinp 

out  bonfires**  strategy. 

fir^t  reading  that  B  and  y  mean  the  same  thing,  but 
It  may  seem  at  „as  our  experiments  which  led  us  to  see 

this  is  not  true,  and  in  t^ct  it  grew  out  of  the  research.  The 

this  distinction:  this  °  respect  to  alternative  sequences 

point  is  that  time  into  ^he  future,^with^reject^^^^^.^^  available. 

of  (planned)  action,  from  the  deadline  can  be  done  first. 

In  other  words,  the  task  w  deadline  done  lator.  The  only  absolute 

;olsS:in?:  Su^sef  irtSt^"  can  be  ..donC  after  it  crosses  the 

deadline. 

5.  Results  from  the  Model 

OO.  have  ..porlncord  vlCh^th.  -o^d  ICsdf  - 

situations.  In  ^°g%xpected,  that  zero  B  and  zero  Y  are  best, 

the  outset  we  have  ^tart,  and  an  optimal  trajectory  as  de- 

feLfnedTy'^Liic  T^gramming  is  optimal  in  an  absolute  sense. 

curiously,  this  is^not  true  aigoSthreom- 

continually.  Let  us  haapd  on  what  blocks  are  in  view  at  the  time, 

putes  an  optimal  r  gtep  of  that  optimal  trajectory.  Thus, 

then  commits  itself  to  e  time”,  optimal  may  be  to  do  a  rela- 
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1  1C  the  only  one  available.  But, 

then  to  complete  an  important  tas  ”  ^  important  task  appears 

v*ile  doing  the  Another  important  one.  A  choice  must 

with  the  same  opportuni  y  tasks  sin'te  only  one  tasK  can  be 

Te  made  between  the  two  be  lost.  Had  tl>e  model 

attended  to  at  a  time;  one  comins  it  would  have  attended  first 

expected  the  new  task  «  unimportant  close-to-dead- 

to  the  available  important  task,  igno  b  important  one.  In- 

U„.  one  -ns  descnlbed  .elon. 

Stances  o  varying  T  values  (reac- 

Out  nodel  tuns  thus  fsr  had  ‘o— ,  values  have  been 

tlon  ttaes)  and  ';*'n!nes  of  expethnental  subjects  on  a  one- 

matched  to  average  reaction 
run-at-a-time  basis. 

We  have  let  the  to^P«ter  compare  human^DM^resul^^^^^^^ 

results  separately  on  the  basis  of  fi  possible  value 

cent  value  gained  for  the  ®  g''®"j^’^“^pleted  tasks  independent  of  ^“tation 
obtainable;  2)  Percentage  of  al  J  and  human  subject  acted 

or  importance;  3)  s<l«^ted  differences  between  cumu- 

on  Che  same  tasks  at  the  sa  summed  over  the  entire  run, 

lative  value  gained  by  model  ^^ine  gained  by  model  and 

Lrfrr^ril^rirLtrrval.  surged  over  the  entire  run. 

.inures  3  through  7 

for  JSe^sam/subjlcf  for  a  =P^®‘*/;^jf^!ant^^ibjefts“ fof a  proLctivity 

lSrrha^o^t^e^Lrlin  !'  ^"’^Jrdl^lfre^rvri^erore  riSr'^coLrnt'ree 
;--aVerorfof^ 

values  of  \<-S’’\"3f^inL"re5res;nt' human  data  ‘^^^^rr^is 

runs.  The  horizontal  line  P  between  human  and  model.  Each 

condition.  Circles  are  comparisons^bet^_^^^,^^^  ^ 

for  measures  according  -  resent  the  same  model  run.  Or  in 

-Cs  “of  So  ;:'SSLrcvu/cU  SCO  sho»  sc  ChS  bibht. 

Thus,  considering  f ^atSed^ trthriine*'foi°best  fit  to 

»''“fL”%rrs%fesu4:  St  sss  Sd  risr  .s  s  b.  .lui-iood. 

The  thir  p  evident  that  the 

For  the  first  tt^lowlr  values  of  B  or  Y  doint 

model  closely  approximates  teu,  or  no  discount)  while 

slightly  better  (--%riSrir-r-  (where  the  model 

At-  higher  values  doing  g  is  not  ailowea  to  Cu,..-— r  b . 

to  "plan  ahead",  i.e.b  P  larg  , 
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PUNMED  ACTIONS  PISCOUMT  fOR  PlSTAMCl  fROH  PEADUHE 


5 
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Figure  3.  Condition  1*  BASELINE: 
interarrival  20  sec/queue 
speed  0»1  units/sec 

productivity  0»5  units/sec 
Subject:  KT 


DISCOUNT  FOR  PUNNED  ACTIONS  DISCOUNT  fOR  PlSTANCc  FROM  DEADLINE 


UHIGLNAL  PAGE  13 
OF  POOR  QUALITYI 
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Figure  4.  Condition  2 

Interarrival  20  sec/queue 
speed  0,25  unlts/sec 

productivity  0.5  imits/sec 
Subiect:  KT 


uHiGINAL  PAGE  IS 
OF  POOR  QUALITY 
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Subject; 


SlIOUOV  03IUV14  SOJ  liinossifl 
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.^activity  0.25  untts/sec 


far  from  Che  deadline,  i.e.,  y  is  large).  Interestingly,  however,  for 
data  on  the  first  two  pages  zero  6  is  not  quite  as  good  as  a  slightir 
J‘’®,^'i°°''etical  reason  for  this  was  discussed  above,  i.e 
with  a  slight  discounting  of  the  future  the  model  is  more  apt  ^o  do  ^he 

high  JaJoff!"*'  "•’i*'** 

little"r?r’'i^‘*'’a  suggests  that  a  person  with  lots  to  do, 

little  time  to  do  it,  and  new  tasks  continually  popping  up  with  rela¬ 
tively  short  deadlines,  should  not  plan  too  far  ahead.  Mostly  he  should 

fL  Jr  ”'°T  closest-Co-deLllne 

fjd  dJesn^r  farther  into  the  future 

plJn  opportunities  to  be  popping  up,  he  should 


With  respect  to  the  second  criterion  (%  tasks  completed)  it  is 
of  R  the  model  and  human  match  precisely  in  a  mid  range 

ofj  which  is  al^  the  best  match  of  model  to  human  for  tasks  which 
common  to  both  model  and  human.  This  suggests  (1)  that  a  S  in 
this  range  is  a  good  candidate  for  a  model,  (2)  that  the  higher  task 

^  ”"Pes,  without  con- 
t  ^  increase  in  total  value  gained,  meant  it  was  wasting  time 
on  „„l.porto„t  t«kp  The  ,  fit.  tot  this  etlterlon  are  not  L  gL 
or  so  consistent,  and  we  begin  to  see  that  y  seems  not  to  be  a  very 
meaingful  parameter.  ^ 


the 

same 

verv 


As  for  the  next  parameter,  %  of  time  acting  on  the  same  task  it 
same  time,  it  appears  that  the  6  curve  peaks  at  approximatelJ  the 

value  for  several  of  the  subjects,  but  again  the  y  curve  is' not 
interesting. 


The  curves  for  the  final 
except  that  the  fourth  curve 
6  values  at  0.1  or  larger. 


two  criteria  seem  to  have  little  to  offer 
consistently  takes  a  jump  (gets  worse)  for 


Further  experiments  will  seek  to  refine  the  model, 
criteria,  and  possibly  add  an  estimator  of  future  tasks 
timization  algorithm. 


the  fitting 
to  the  Op- 
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Appendix  1.  The  Model  In  Relation  to  Ar.„'h  Th„,,.* 

shown  in  Figure  Al.  coordinate  framework  we  have  graph  G^(t)  as 

nodes!'°which^Lcidentallv^Ln  represent  transfer  times  between 

i-onstraints  can  be  imposed.  tR  t^'^and^tP'arrv^"!’  precedence 

and  **processing  time**  resoGctivplv  m  ^  fu  ,  deadline  time 

with  rhe  tash,\re  coJeL'r^m  Ly  hU  h^'drL'^i™ 
associated  with  a  node  will  be  as  shoL  in  v-  r-t  curve 

which  tl,e  DM  can  get  partial  Jr^Hi^  T  ^^8ure-A2a.  For  the  case  in 

being  Fixed-Loss,  will  be  Is  shown  In  ^Igure'lAab 

‘~S^«:J“ut:’pL“;dtsJ"L'nd“u,; 

“ady!"..:  -  Idd.lllne-tl.I  UI;'. 

- 1\ 

nod. ».  yu... ::::  r.rpr"t  r.  fjnc'trtf 

nlu’cVdonJ  nnc';ncL."’L“  JLlw  ‘"f'  “t(‘)  ^  «  ■  (2.1.4) 

nolnpL'^rnrro::J^^":h^Lt^L"t‘^*lts^^rd“^1h'r^rd‘^ 

Traveling  Salesperson,  etc.  (Golden  and  Magnanti,  1977).  ^  Scheduling, 

accordLr^o^JL^i:n^^;5^gtiL^;“:r^"^ 

1)  Will  multiple  journeys  between  the  nodes  be  counted  multiple? 

2)  Can  we  add  extra  nodes? 

3)  Can  the  rewards  associated  with  the  nodes  be  delay-dependent’ 

TffTrlnlT""'""  different  pairs  of  nodes  be 


5) 


Is  it  imperative  to  return  to  the  base  node? 


-r»'ln“L'uy7Tj°  = 

,7)_Cnn  th.  grnph  G,  desrlhinp  tho  problem  chnng.  dynnmically 

_ _ ^  ^  1  d-  . 


See  list  of  symbols  at  end  of  Appendix  7. 
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FIGURE  A2  Reward-Time  Curves  for  a  Task  (a)  when  no  Partial 

Credit  is  Given,  and  (b)  when  Partial  Credit  is  Given 


Using  these  criteria  we  have  listed  some  common  combinatorial  optimiza¬ 
tion  problems  with  two  new  ones: 


a) 

b) 

c) 

d) 

e) 
£) 


Minimum  Spanning  Trees,  MST  (Kruskal,  1956) 

Steiner  Tree  Problem,  STP  (Nijenhuis  &  Wilf,  1975) 

Job-Shop  Schodollng,  JSS  (ElmshrPby,  1968  «hd  Sahnl,  1976) 
HO.1U0O  Cyolo.  HC;  P11.P  the  Traveling  Saleaperaon  Preble. 
(Held  &  Karp,  1962) 

open  Tulga-Path,  OPT;  alias  Multi-Task  Attention  Allocation, 
Closed  Talga-Path,  CTP 


Zj  - - 

Note  that  i"' ^able-Al  the  indicator^' O^^means^thatjhe^P^^^  indicator  ’1’ 

terion  need  not  be  satisfi  indicating  that  the  criterion  is  not 

is  lor  the  opposite  J”l‘Ts"heLtU  representation  of 

SSe^oftL  proble.s”  OTp'descrlbes  Multi-Task  attention  ailotation.  _ 


Problems  vs. 
Criteria: 

1 

2 

3 

A 

5 

6 
7 


MST 

STP 

JSS 

HC 

OTP 

CTP 

0 

0 

1 

1 

1 

1 

0 

1 

N/A 

N/A 

N/A 

N/A 

0 

0 

1 

0 

1 

1 

1 

1 

0 

1 

1 

1 

0 

0 

0 

1 

0 

1 

0 

0 

0 

0 

0 

1 

n 

0 

0 

0 

1 

1 

\J 

Table-Al» 

Properties 

of 

Various  Sequencing 

Problems 

gefore  -  -  HuUl-Task  Sup—  ^ntrol.^the  reader 

“Lf rt«Lf”th1  nl»  nu.ber  of^- 

cles  or  people,  the  OTP  problL  will  become  an  advanced 

node-3  i*‘/jS“’'t;in!pajllng  Problem* .  (Johnson,  1974)  The  reader  may 
version  of  the  Bin  t'acK.xng  rnnA  rontroller)  of  the  human 

note  here  the  ease  of  computer  aldi  8  pn  Figute-AJfiv)  an 

operator  (1st.  '“‘“'ll"'-  .  """f  to  Se  base  node  before 

extra  vehicle  ci„e  T.  Is  sufficiently  large,  node-4 

SLorr::;v“e3‘:h:t  -at  the  number  'J 

Lr  L-5i:ired“;i‘hrci:=^irg  ste:?.!  «ioiden.  1976, 

Me  can  see  fro.  8i,"S“if„rtor“^ 

Sdtf  thaf  nodrolSIse  nod.)  Is  vh.te  the  DM  currently  Is,  and  4  tasks 
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ORIGINAL  PACn, 
OF  POOR  QUALITY 


FIGURE  A3  Graphical  Representation  of  Some  Sequencing  Problems 


FIGURE  A4.  The  Return^  for  a  Task^as  a  Function  of  Time  for  the  Partial 
Credit  Mode 


585 


are  (or  will  be)  available  with  different  properties.  The  DM  will  then 
act  on  the  first  task  of  the  optimal  schedule,  II"  *  (2,1,4),  i.e.  task  2. 

Note  however,  that  new  tasks  may  appear  on  this  graph  Gj(t)  probabi¬ 
listically  according  to  the  interarrival  rates  and  with  the  task  para¬ 
meters  explained  in  the  paradigm  section,  and  the  thing  to  be  maximized 
is  the  reward  gained  at  the  end  of  the  experiment,  so  that  tasks  that  are 
going  to  appear  cannot  be  ignored.  That  is  to  say:  since  graph  Gjft) 
is  time-dependent,  then  the  optimal  schedules  11  (t)  on  them  are  time- 
dependent  too* 


Appendix  2.  Optimization  Alt»orltlii»  of  tue  Model 

In  choosing  his  control,  i.e.,  which  task  to  at  upon,  we  can  model 
the  DM  as  an  optimal  controller  who  maximizes  his  expected  returns  over 
a  planning  horizon.  (Koopmans,  1964).  In  particular,  the  DM  will  act 
to  maximize  his  expected  total  returns  over  a  finite  planning  horizon, 
T,  with  a  discount  function  B(6,  t) : 

T 

max.  r(n)  =  E[  ^ 


where 


(i,j)en 


R..(t) 


B(S,  t) 


in  which  the  summation  is  over  all  the  tasks  (i, j) ,  which  collectively 
make  up  the  ordered  task  set,  schedule  11,  that  the  DM  expects  to  act 
upon  over  his  planning  horizon.  Rij(t)  is  the  return  he  gets  for  acting 
on  (or  completing)  the  task  (i,j)  during  (or  at)  time  t. 


For  the  case  in  which  the  DM  gets  credit  continuously  while  acting 
on  a  task,  the  Rij(t)  will  be  as  shown  in  Figure-A4. 

In  Figure-A4,  tij,  Pij.  dij,  p^j  represent  the  time  at  which  the 
DM  plans  to  start  acting  on  the  task,  the  value  density  of  the  task,  the 
duration  of  the  task,  and  the  productivity  of  the  DM  for  the  task  (i,j), 
respectively* 


If  however,  the  DM  is  going  to  get  (full)  credit  only  after  success¬ 
fully  completing  a  task,  then  the  Rij(t)  will  be  as  shown  in  Figure-A5. 

The  DM,  in  effect,  will  choose  at  each  decision  point  a  schedule 
n°  =  (n°  n?,...)  that  he  intends  to  act  upon  to  maximize  his  expected 

returnsl'and'then  he  will  actually  act  upon  the  first  task  llj,  in  this 
ordered  set  of  tasks • 


It  is  probable  and  acceptable  that  he  might  have  to  give  up  on 
acting  on  some  tasks  when  their  ’available  times'  are  small  -  due  to 
their  high  speed  and/or  due  to  their  proximity  to  the  deadline  -  or 
when  they  have  comparatively  low  value  densities,  especially  in  compe- 
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FIGURE  A5.  The  Return^  for  a  Task^as  a  Function  of  Time  for  the  No-Part lal 
Credit  Mode. 


Pt^io^iTY 


TiMe 


FIGURE  A6.  Increasing  Priorities  of  Different  Tasks  as  They 
Wait  to  be  Served. 


tition  with  other  simultaneously  available  tasks  which  are  preferred  in 
these  respects.  Another  important  parameter,  of  course,  is  the  trans- 
fgy  time  between  the  queues.  He  has  to  consider  the  fact  that  he 

will  end  up  getting  no  credit  for  a  period  of  time  when  he  transfers  his 
control  from  the  i.th  queue  to  the  i*.th  one. 

The  algorithm  for  finding  the  optimal  schedule  of  tasks  11  ,  to  act 
upon  is: 

Algorithm  TJPATH 

Input  (usage,  T^,  ^ii” 

The  input  parameter  ’usage*  indicates  whether  an  OTP  or  a  CTP  is 
desired,  and  if  it  is  a  CTP,  Tr  is  used  as  the  required  return  time  to 
the  base  node.  T  is  the  transfer-delay  time  matrix  between  the  queues 
of  tasks  and  B,  and  G  are  discount  functions  on  future  returns  and  on 
tasks  away  from  the  deadline-tasks  with  larger  slack-times  respectively. 

Note  that  the  system  state  tensor  XijR  specifies  the  various  task 
parameters  for  each  given  instant  of  time  like: 

whether  the  task  is  available  (display)  or  not,  Lij  (=1  or  0) 
the  return  associated  with  the  task  as  a  function  of  time, 

p 

the  processing/service  time  of  the  task  t£j(t) 

Cjie  ’available  time'  of  the  task, 

optimal  schedule  11°,  and  discounted  present  value  r(n°)  and 
completion  time  c(n°)  associated  with  it. 


1) 

2) 

3) 

4) 

Output 


Step-1  [initialize] 

for  i  =  1  to  I  do 
for  j  =  1  to  J^do 

while  Lij  =  1  do  /*  is  the  task  available  ?  */ 
transform  (i,j)  to  d  and 
generate  the  tuple  (r(d),  c(d)) 


r(d)  =  %(t  =  0) 
c(d)  =  +  t^(t  =  0) 

end 


end  ^ 

Note  that  Rj^(t)  =  /  j  T)  •dT 

Furthermore,  the  tasks  currently  available  are  summed  to  give  N.  which 
is  also  the  maximum  number  of  stages,  M,  the  optimal  schedule  can  have. 
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Step-2  [Generate  schedules  that  are  m  stages  deep] 

for  m  =  2  to  M  do 

generate  all  m-member-subsets  =  S 
and  for  each  task  ZeS 
generate  the  (r(n)  i  c(n))  tuple(s) 

-Xi;here  IT  i  i.e.  schedule  IT  is  schedule 

V7ith  task  I  at  stage  m, 

-for  each  order^S-^},  i.e.  for  each  n'  ?  [s-H}, 

—where  the  operator  tests  whether  each  member  of  one 
set  is  aloo  contained  in  the  other.  (Weinberg,  1971) 

r(n)  =  r(n’)  +  R^(t  =  c(n')) 
c(n)  =  c(ii’)  +  +  tj(t  »  c(n')) 

where  is  the  last  task  -  task  at  stage  (m-l)  in  schedule  I!'. 
Eliminate  schedules  according  to  the  rules: 

1)  Eliminate  the  tuples  which  are  infeasible,  that  is  credit 

cannot  be  obtained  from  the  last  task  Z  in  schedule  IT 
before  it  reaches  the  deadline J  or  if  usage  is  CTP,  before 
(Tp^  -  vdiere  is  the  transfer  time  between  the 

queue  of  task  Z  and  tlie  base  node  0.  -  . 

2)  Eliminate  schedule  if  there  is  a  schedule  II'',  such  that: 

3nd  i  =  Z‘'  or  queue  of  2,^  =  queue  of 

"^Zs  are  the  last  tasKs  —at  stage  m—  in  the  respective 
schedules- 
and  r(n^) 

and  c(Il^p  c(n^) 

3)  Eliminate  the  schedules  that  are  less  than  (m-l)  stages 
deep. 


Step-3  [Return  to  the  base  node  if  usage  is  CTP] 

if  usage  =  Closed  Tulga-Path  then 
for  all  schedules  IT  do 

r(n)  =  r(n)  +  R^(t  =  c(n)) 
c(n)  =  c(n)  + 

with  Z  being  the  last  task  nf  ^chediilz  II. 
end 


ORIGINAL  PAGE  IS 
OF  POOR  QUALITY 
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Step-4  [optimal] 

The  optimal  schedule  is  the  one  with  the  property: 

r(n®)  >  r(n)  for  all  11  11®. 


and  if 


r(Il®)  *  r(n)  then  c(II®)  <  c(II) 


Note  that  when  the  rewards  of  nodes  are  delay-independent  then  this 
aleorithm  reduces  to  the  dynamic  programming  formulation  of  the  Traveling 
ir.  (H.lS  »  K,rp,  1962)  On  the  othnr  ' 

fer  delays  between  all  tasks  are  equal  and  when  rewards  of  all  tasks  are 
wvoa-TnQ.;  1  e  constant  up  to  a  certain  delay  (time)  and  then  zero,  then 
the  solution  will  reduce  to  Job-Shop  Scheduling  with  Deadlines.  (Elmaghra  y, 
1968  and  Sahni,  1976). 

Several  things  should  be  clarified  at  this  point.  First,  if  the  model 
is  peLitted  to  git  partial  credit,  as  in  Figure-A4,  then  the  tasks  which 
will  hit  the  deadline  before  they  can  be  complted  will  also  be  included 

in  the  optimization,  although  with  their  returns  Rij(t)  ®  " 

^r«flect  the  gain  that  can  be  obtained  frol  them  before  they 

disappear. 

nnint  that  should  be  emphasized  is  that,  since  all  the  dynam- 
ics  of  the  talks  are  known  a-priori  by  the  algorithm  (and  also  by  the  human), 
tllrfil  no  lied  to  repeat  the  optimization  unless  there  is  a  new  task 
arrival-  when  no  new  Information  is  presented,  the  optimal  plan,  i.e.,  the 
cllleltly  optimal  schedule  will  be  followed  in  real  time  as  ^he  asks  in 
Ihil  llnLd  list  are  completed.  It  has  also  been  proven  theoretically 
(McNaughton,  1959)  that  there  is  nothing  to  be  gained  by  shifting  attention 
from  one  task  to  another  and  back  again,  even  in  the  case  of  no  time 

fnr  doine  so.  On  the  other  hand,  if  after  a  ntv  task  arrival 
thl  first  task  in  the  new  optimal  schedule  is  not  the  task  that  ^ 

llLrlttended.  then  the  model  will  pre-emptively  leai  e  the  t^rent  task^to^^ 
hVio  task  in  the  new  optimal  schedule.  However,  the  task 

pre-Ltively  abandoned  might  still  be  in  the  new  schedule,  and  conditions 
permitting  may  eventually  be  re-attended. 

The  effect  of  G(Y,  t®)  will  be  to  adjust  the  return  Ri^t)  for  acting 
on  task  (i,j),  by  changing  the  effective  value  density  of  the  task  (i,j) 

as: 


R..(t)  =  R..(t)-G(Y,  t‘  .) 
IJ  IJ 

^s 


r®  is  the  slack-time  of  the  task,  i.e.,  t®  =  max.-(o,L(x/x)-(d/p)]} , 
i^d  p  repreSnting  the  current  position,  speed,  current  duration 
aid  th^  ^roductLity  associated  with  the  particular  task,  respectively. 
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t]ot6  that  tha  Idea  of  weighing  tasks  according  to  their  Initial 
priorities  plus  incremental  priority  increases  as  they  wait  in  a  queue 
(Carbonell,  1966  and  Jackson,  1965),  as  shown  in  Figure-A6,  corresponds 
to  the  G(y,  tS)  function,  where  the  initial  priority  if  determined  by  the 
initial  proximity  of  the  task  to  the  deadline,  and  this  priority  in¬ 
creases  as  the  task  approaches  the  deadline. 

It  is  interesting  to  note  also  that,  as  the  speeds  of  the  tasks 
approach  zero,  i.e.,  the  deadlines  are  at  infinite  future  time  -  and 
if  the  transfer  times  between  all  the  tasks  are  equal,  then  the  DM  is 
modeled  to  choose  the  new  task  to  act  upon,  according  to: 


max . 

(i,j) 


This  of  course  is  the  familiar  result  from  the  Queueing  Theory  (Smith, 
1956)  when  we  consider  the  productivity  ^f  the  DM,  P...  as  the  service 
rate  and  the  value  density  of  the  task  (i,j)  P. .  As  the  negative  cost 

per  unit  time  delay 


min. 

(i.j) 


c  U .  .  where  c ,  .  <  0 


List  of  Symbols 


G  graph 
t  tine 

T  transfer  tine 
T  dummy  time 

r  reward  available  at  a  node  (task.) 

R  reward  gained  for  a  given  plan 

r(TI)  total  discounted  return  of  a  schedule 
n  a  schedule  completion  time  of  a  schedule 

that  schedule  which  is  optimal 
Tj^  deadline  time  for  return  to  base  node 

T  planning  horizon 

B  discount  function  on  future  returns 

3  discount  parameter  (rate  in  this  case)  on  luture  returns 

G  urgency  discount  function 

Y  urgency  disenunt  parameter  (rate  in  this  case) 

1  total  number  oT  (pieucs  ^ 

J»  total  number  of  tasks  in  queue  i- 
combination  of  i  &  j  for  any  task 
•I  maximum  number  of  stages  that  optimal  schedule  can  have 
m  stage  index 

d  duration 
X  speed 
p  value  density 
p  productivity 

V  rvrko  1  t"J  on 
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processing  time 

t  ready  time 

t^  deadline  time 
A 

t  available  time 

S 

t  slack  time 
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PERCEPTUAL  FACTORS  INVOLVED  IN  PERFORMANCE  OF  AIR  TRAFFIC 
CONTROLLERS  USING  A  MICROWAVE  LANDING  SYSTEM 

Gary  Gershzohn* 

San  Jose  State  University  Foundation 
San  Jose,  Calif. 


SUMMARY 


This  study  investigated  performance  of  air  traffic  controllers  using  a 
Microwave  Landing  System  (MLS).  Eight  professional  radar  air  traffic 
controllers  acted  as  subjects  and  performed  their  normal  duties  within  the 
constraints  of  the  experimental  design  and  simulation.  The  task  involved 
the  control  of  two  simulated  aircraft  targets  per  trial,  in  a  37.0-km  (20- 
n.  mi.)  radius  terminal  area,  by  means  of  conventional  radar  vectoring  and/ 
or  speed  control.  The  goal  was  to  insure  that  the  two  targets  crossed  the 
Missed  Approach  Point  (MAP)  at  the  runway  threshold  exactly  60  sec  apart. 

The  effects  on  controller  performance  of  the  MLS  configuration  under  wind 

and  no-wind  conditions  were  examined.  ^ 

The  data  for  mean  separation  time  between  targets  at  the  MAP  and  the 
range  about  that  mean  were  analyzed  by  appropriate  analyses  of  variance. 
Significant  effects  were  found  for  mean  separation  times  as  a  result  of  the 
conf i Qurdtion  of  the  MLS  end  for  interaction  between  the  configuration  snd 
wind  conditions.  The  analysis  of  variance  for  range  indicated  significantly 
poorer  performance  under  the  wind  condition.  These  findings  are  believed  to 
be  a  result  of  certain  perceptual  factors  involved  in  radar  air  traffic 
control  (ATC)  using  the  MLS  with  separation  of  targets  in  time. 


INTRODUCTION 


This  study  was  designed  to  investigate  some  of  the  perceptual  factors 
which  affect  performance  of  air  traffic  controllers  using  an  MLS  to  control 
the  landing  of  aircraft.  The  MLS  is  a  new  type  of  landing  guidance  aid  and 
is  still  in  an  experimental  phase.  When  fully  operational  its  primary 
purpose  will  be  to  facilitate  the  safe  an  expeditious  flow  of  a  new  genera¬ 
tion  of  aircraft  into  airports  with  an  efficiency  that  cannot  be  duplicated 
today.  The  implementation  of  the  MLS  will  require  an  alteration  of  the 
physical  structure  of  airways  and  the  ATC  system.  ^  j.  ,  . 

A  radar  scope  was  simulated  on  a  cathode-ray  tube  (CRT)  and  displayed 


*This  author's  research  was  supported  by  NASA  Grants  NGL  05-046-002 
and  NSG-2269  to  San  Jose  State  University, 
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a  terminal  area  with  the  MLS.  The  controllers  were  presented  with  several 
air  traffic  situations  and  were  required  to  separate  targets.  The  experi¬ 
mental  goal  was  to  identify  some  of  the  perceptual  factors  involved  in  and 
the  performance  of  controllers  using  the  MLS. 

f  k  is  one  of  the  most  recent  developments  in  ATC,  and  as 

such  has  not  been  the  subject  of  lengthy  investigation,  research  in  aeronau¬ 
tics  has  placed  considerable  emphasis  on  developments  in  human  factors 
aspects  of  ATC.  The  literature  contains  numerous  reports  on  topics  such  as 

(').  "Ortload  (11).  Snd  the  role  of  eStom^ 
tion  (10).  The  general  picture  of  the  evolution  of  ATC  responsibilities  and 
required  performance  has  also  been  outlined  (8,  9).  By  and  large,  data  on 
basic  human  perceptual  processes  specifically  involved  in  ATC  has  received 
nc  attention.  Therefore,  this  study,  in  part,  examined  pertinent 

psychological  literature  on  visual  motion  perception  in  order  to  analyze 
performance  of  controllers  using  the  MLS.  ^ 


METHOD 


The  geometric  arrangment  of  the  MLS  as  viewed  on  the  radar  scope  is 
significantly  different  from  conventional  Instrument  Landing  Systems  Where¬ 
as  current  Instrument  Landing  Systems  employ  a  single,  straight  course  to  the 
runway,  the  complex  MLS  in  this  experiment  was  composed  of  five  courses  both 
straight  and  curved.  In  order  to  evaluate  the  effects  of  thirp“?kSlar 
deveioper’°"  controller  perception  and  performance,  a  specific  task  was 


Subjects 

an  hJ’fJ  Pf-ofessional  air  traffic  controllers  served  as  paid  participants 

J  Ih  tf’e  military  or  FA^a^ 

high  traffic  density  locations. 


Apparatus 

c  ^  25.4-cm  (10-  by  10-in.)  CRT  display  was  generated  bv  an 

Evans  Line  Drawing  System  interfaced  with  a  Digital  Equipment 

Corporation  PDP  11/40  computer.  Figure  1  illustrates  the  simulatioS  E 
represented  the  ATC  scope  with  the  MLS.  The  scale  of  2.9  km/cm  (4  n  '^mi  /in  ) 
was  close  to  standard  usage.  ^n/cm  n.  mi ./in.) 

Aircraft  targets  were  represented  by  triangles  measuring  .45  cm  (  18 
in.)  on  each  side.  Each  symbol  was  labeled  by  a  single  alphanumeHc  tag  for 
use  by  the  controller  in  identifying  and  tracking  targets.^  The  targets^ 
appeared  to  move  in  a  manner  not  unlike  those  on  conventional  radar  ATC 
scopes.  Simulated  aircraft  had  several  basic  movement  capabilities:  (a) 
entry  along  an  MLS  route  at  the  periphery  and  complete  trackino  tn  tho  mad 
ID)  aiitomatic  landing  and  exit  froin  the  display  at  the  MAP,  (cT  headina  ’ 
change  at  a  rate  of  S^/sec,  and  (d)  acceleration  at  a  rate  of  3.7  km/hr 
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Altitude  information 


(2  knots)/sec  (equivalent  to  .0003  cm/sec^  on  the  CRT), 
was  not  rcQuired  for  this  experiment. 

^5-  generated  movement  of  targets  was  controlled  by  the  sub¬ 

ject.  His  vernal  commands  were  transmitted  by  a  standard  microphone  Rerpiu 
oJ^on^t'S??h  these  ATC  instructions  was  the  experimenter  in'tSfrile 

of  pilot  of  the  simulated  aircraft.  Communication  between  the  controller  and 

operations  and  phraseology,  ujon 

to^thp^pnp  iiMn°"^'"°  s  commands,  the  experimenter  input  the  information 

interface  device  which  then 

altered  the  fligh-,  dynamics  of  the  simulated  aircraft  accordingly 


Procedure 

The  task  required  that  the  controller  control  two  targets  per  trial  in 
Sap®'’  If  goal  of  60-sec  separation  between  ‘i^gets  It  the 

U50  knots).  It  was  followifd  approximately  60  sec  later  by  a  second  taroet 

entered  either  along  the  VIKING  route  or  one  of 
the  other  four  MLS  routes.  Since  the  second  target  traversed  one  of  the  fivp 
routes  in  following  the  first  target,  there  were  five  different  Derceotual 
relationships  between  the  two  targets.  These  will  bp  nllpH 

example,  a  target  entering  on  the  VIKING 
(vlGrSttVomh^aliOh""  VIKING-GEMINI 

the  two  targets  crossed  the  MAP  exactly  60  sec  apart.  Each  target  lltlmlti- 
cally  reduced  its  airspeed  to  167  km/hr  (90  knots)  by  the  time  ifrSd  {he 

ii’mitat-^'  keeping  with  normal  aircraft  operatino 

MAP  airspeed  of  167  km/hr  (90  knots)  was  then  maintained  to^the 

AP.  As  the  controller  perceived  the  continuing  relationship  between  the 
targets,  he  had  to  make  a  decision  to  issue  or  not  to  issue  ATC  instrurt-ipnc 

^nliH  hn  t  separation.  The  airspeed  and  heading  of  either  target 

could  be  changed  only  during  the  time  that  target  was  between  the  37  0- km 
(20-n.  mi.)  fix  and  9.3-km  (5-n.  mi.)  fix;  the  controller  lid  rlcei^ld 
instructions  that  no  control  was  to  be  applied  to  a  taroet  aftpr 
the  9  3-kn,  (5-n.  ml.)  f,x.  When  the  secSSd  EargEt  the  .EaJ  tEl  t?l!! 

anH  I”  actual  Separation  in  seconds  was  recorded  by  the  computer 

and  used  as  the  raw  data  for  that  trial.  In  order  tn  mpacuvn  computer 

several  situations,  trials  were  conducted  under  wind  (360°  at  46  km!^r'^{25^" 
knots))  and  no-wind  conditions. 

A"J"troductory  session  familiarized  the  controller  with  the  oeneral 
experimental  purposes  and  MLS.  Written  instructions  S  ^ 
supplied.  Three  practice  trials  with  no-wind  and  three  with  wind  heflL  th,. 
respective  experimental  trials  were  used  for  the  purpose  of  acguaintill  fhJ 

movemeSt  dynamic!  of  tllLtI 

At  the  conclusion  of  each  practice  trial,  the  contmliPr  wgc  ^ 

much  separation  in  time  existed  between  the  two  targets  as  'the;'succl!siJer 
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crossed  the  MAP*  This 
temporal  rel ati onshi ps 
however,  was  not  given 


aave  the  controller  an  indication 
between  targets  under  his  control, 
Hiirina  experimental  trials. 


of  the  spatial  and 
This  feedback. 


Experimental  Design 

•  ctiidied-  (a)  the  mean  separation  time 

Two  dependent  variables  were  stu  •  ^  ^hat  mean. 

between  targets  a^^.^lj^JJJ’^for  rLeated  measures  was  used  to  analyze  the 
A  5  X  2  X  2  factorial  Jor  repe  eo  independent 

data.  The  five  path  combinations  served  a  .  f  ^  jecond  independent 

Variable.  Two  entat?iJ  of  wfnd^i^^^^^  was  the  third 

variable  and  the  order  o  p  tmen'*'  condition  was  presented  first  to 

independent  ,.,i  ® the  reverse  order  was  administered  'to  the 

one  half  of  the  controllers  and  the  re ve  condition 

T/lS'pltH  co..in«,op  -as  a*,nUtara.  to 
each  controller  three  times. 


RESULTS  AND  DISCUSSION 


that 


of  thP  three  separation  times  for  each  controller  was  calcu- 
The  mean  of  the  three  separatiu  analysis  of  variance  was  per- 

lated  and  constituted  the  data  on  which  tn  .  ^  controller  performance, 

formed.  For  the  P“7°s®°^,"°^l"5rfome?Jn  the  range  of  the  separation 
a  second  analysis  o  the^analvsis  of  variance  for  means  are  shown 

times  per  subject.  Results  of  the  means  and  average  ^ 

in  Table  1  and  for  in  Table  2.^^A_summary  ^  respectively. 

ranges  for  each  /  x  n^esentation  of  wind  conditions  was  not 

the  purpose  of  analysts  of  other 

sS “e  -  ■ »  - 

due  to  different  P3^^4°J^].'J®gs°5etween’ta4ets  under  the  no-wind  condition 
The  mean  separation  (B?  0  sec)  were  close  to  the  60-sec 

(60.6  sec)  and  under  the  ..  average  range  of  times  about  these 

target  value,  yet  the  magn  no-wind  condition,  the 

,aans  was  quite  large  (f'S-  ^  “"J  J).  ^  „f  ,an- 

average  range  was  JJ^cally  significant  difference  in  controller 

ance  for  range  showed  a  statisnca =  .p  _  ,2  no-  df  =  1 ,  6;  p<^.05). 

performance  as  a  JJgJns  revealed  no  significant  results  (F  =  .48; 

The  analysis  of  variance  for  means  vea  separation  time  between  targets 
df  =  1,  6;  p>..05).  While  JJ®, f not  significantly  different,  the 
under  the  no-wind  mpans  were  Both  the  no-wind  and  wind  mean  times 

?:&a^MgS'3egr^fo?  ~  »  thf  avers, u  ,n  attatutug  the  eo-sec 
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target  value.  But  the  19.6  and  43.2  sec  ranges  showed  the  accuracy  reflected 
in  the  mean  times  to  be  a  result  of  the  high  separation  times  between  targets 
cancelling  out  the  low  separation  times,  especially  under  the  wind  condition. 

These  results  will  be  discussed  from  three  points  of  view:  (a)  the 
perceptual  factors  involved  in  performance  of  controllers  using  the  MLS,  (b) 
controller  performance  using  time  as  a  relevant  separation  criterion  rather 
than  distance,  and  (c)  the  implications  of  the  findings  for  future  development 
of  the  ATC  system  with  the  MLS. 

The  controller's  perception  of  the  ATC  situation  constitutes  an  impor¬ 
tant  factor  in  understanding  the  results.  Three  primary  perceptual  factors 
are  considered  to  be  of  importance  in  the  controller's  task  in  this  experi¬ 
ment:  (a)  spatial  separation  of  targets,  (b)  figure-ground  (map  overlay) 
effects,  and  (c)  the  perception  of  wind-generated  accelerated  motion.  The 
latter  point  appeared  to  be  most  significant  in  evaluating  the  data  and 
requires  special  consideration. 

The  mean  separation  time  under  the  no-wind  condition  was  closer  to  the 
60-sec  target  value  than  under  the  wind  condition.  This  was  due  primarily  to 
the  controller's  difficulty  in  taking  into  account  the  differential  effects 
of  wind  on  ground  speed  as  the  target  changed  heading.  The  difficulty  in 
perceiving  the  onset  of  of  accelerated  motion  had  several  consequences  for 
controller  performance.  First,  the  reduction  of  the  ground  speed  of  a  target, 
either  in  the  automatic  speed  reduction  phase  of  the  approach  or  as  a  result 
of  the  wind,  altered  the  separation  between  it  and  the  other  target.  Should 
the  velocity  change  have  gone  undetected,  the  result  would  have  been  a  new 
amount  of  separation  between  targets  of  which  the  controller  was  completely 
unaware.  Obviously,  a  concinuous  series  of  such  changes  by  one  or  both 
targets  would  lead  to  inaccurate  and  erratic  performance  such  as  was  evident 
under  the  wind  condition.  Second,  the  perception  of  acceleration  of  one  or 
both  targets  required  ar.  evaluation  by  the  controller  of  the  actions  neces¬ 
sary  to  maintain  or  change  the  relationship  between  the  targets.  This 
necessitated  the  ability  to  make  an  accurate  prediction  of  the  future 
progress  of  the  target  undergoing  acceleration.  It  has  been  shown  by 
Gottsdanker  (4-6)  and  Gibson  (3)  that  future  target  position  during  constant 
velocity  motion  can  be  predicted  with  considerable  accuracy.  However, 
predicting  target  position  during  accelerated  motion  was  found  to  be  general¬ 
ly  inaccurate  and  appeared  to  be  based  on  the  last  perceived  velocity  rather 
than  on  acceleration  (2,  7).  The  apparent  inability  of  the  controller  to 
successfully  predict  the  accelerated  motion  of  targets,  and  hence  future 
positions  in  time,  was  associated  with  high  variability  in  performance. 

Third,  the  changes  in  ground  speed  of  a  target  traversing  that  part  of  the 
MLS  course  that  curved  toward  the  airport  were  difficult  to  assess.  The 
controllers  reported  that  the  point  in  time  when  the  ground  speed  began  to 
slow  was  not  immediately  apparent  nor  was  it  possible  to  accurately  predict 
the  future  motion  of  targets;  The  large  magnitude  of  the  change  in  ground 
speed  in  those  MLS  courses  with  long  curved  segments  made  accurate  perceptions 
difficult  and  inaccurate  performance  most  evident  in  the  results.  The  accel¬ 
erations  that  occurred  within  the  curving  courses  were  most  significant  under 
the  wind  condition  and  posed  a  situation  which  the  controllers  were  unable  to 
gauge  precisely. 

On  the  basis  nf  Hi?cussions  with  the  controllers  after  the  experiment, 
it  would  appear  that  the  controllers'  attempt  to  separate  the  two  targets  by 
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eo  sec  at  the  SSa^x 

„“„f  srrpH>n™inc=  controUars^^^^^^^^^  tKe,  were  facad 

heretofore  described),  soeed  reduction  (which  4.4 nn  hon;^n  the 

Snot  to  tda  c^»aat  ^  ra'?,™S'‘’  1sTa5;i«d 

constantaratas-t^  of  tha  Pfdsant  axpari«t^1;d>^^^^^^^  ™,  ,, 


ffiS  £?ssi"K”  S' "  n,".r" 

•■”  'S  SKS-  “  ■SS’S'JSS  "S“»"SSS;“ . 

performance,  it  ^eems  unlijcely^th^t  p^suive  ’ 

i;\ra'.:irfrt»o^ 

moattiired  bv  the  number  ot  targei-s  a  ^u-a-pm  with  complicating  interseci-iiiy 

Sbrrira  ^  "rarariticW 

load  might  reach  as  Workload  was  minimal  yet 

sr- a"ti^nifSn“t  a  ^ 

aircraft,  «i>-‘<  “•™'- 


598 


systems,  cockpit  displays,  and  possible  alterationc 
configuration  may  alleviate  some  of  the  problems  that  faced 
ntrollers  in  this  simulation.  Such  improvements  may  allow  conventinn;ii 
radar  ATC  using  the  MLS  with  a  real  world  workloL  conventional 
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*  p<.05 

^  p<.01 


ORIGIN  Ali 
OF  POOR  quality 


TABLE  2 


Analysis  of  Variance  of  Range  About 
Mean  Separation  Times  between  Aircraft 
Targets  at  the  MAP 


#  f 

Source 

df 

MS 

Error  Term 

r 

F 

Order  of  presentation 

1 

68.45 

0 

.07 

of  wind  condition  (A) 

Path  combination  (B) 

4 

556.32 

B  X  0 

.98 

Wind  condition  (C) 

1 

11,092.05 

C  X  D 

12.42^ 

Subjects  (D) 

6 

929.25 

A  X  B 

4 

451.45 

B  X  D 

.80 

A  X  C 

1 

344.45 

C  X  D 

.39 

B  X  C 

4 

551 .98 

B  X  C  X  D 

1.03 

Ib  X  D 

24 

565.02 

Ic  X  0 

6 

892.91 

j 

•A  X  B  X  C 

4 

178.89 

B  X  C  X  D 

.33 

B  X  C  X  D 

24 

536.10 

®  p<.05 
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TABLE  3 


Suimary  of  Mean  Separation  Times  (in  seconds) 
between  Aircraft  Targets  at  the  MAP  by 
Path  Combination  and  Wind  Condition 


t 


“1 

Wind  condition 

Path  combination 

<  f  1  »  1  f  »  ' 

no-wind 

wind 

across  no-wind/wind 

v-v 

62.6 

71.5 

67.1 

V-G 

58.1 

56.2 

57.1 

V-A 

59.1 

41.4 

50.2 

V-P 

65.4 

52.4 

58.9 

V-M 

57.7 

63.4 

60.6 

Across  all  path 
combinations 

60.6 

57.0 

58.8 
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ORlGn'JAL  PAGE  IS 
TABLE  4  QUALITY 


nummary  of  Average  Ranges  (in  seconds)  about  Mean 
^2™®^  between  Aircraft  Targets  at 
the  MAP  by  Path  Combination  and  Wind 
Condition 


t 


\ 

r  ■  - 

Wind  condition 

Path  combination 

1  ( 

no-wind 

-1 - - - - 

wind 

across  no-windA  ‘d 

V-V 

i  19.1 

24.8 

21.9  ■ 

V-6 

i  20.9 

1 

54.5 

37.7 

V-A 

20.1 

42.9 

31.5 

V-P 

24.0 

1 

45.1  { 

34.6 

V-M 

14.1 

1 

48.8 

31.4 

Across  all  path 
combinations 

1 

19.6 

43.2 

31.4 
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Figure  1.-  MLS  route  configuration  as  seen  on  controller's  display 
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MEAN  SEPARATION  BETWEEN  TARGETS  IN  SECONDS 


ORIGINAL  PAGE  B 
OF  POOR  QUALITY 


□  MEAN  SEPARATION  TIME 


RANGE  ABOUT  MEAN 
SEPARATION  TIME 


V-V  V-G  V-A  V-P  V-M 

PATH  COMBINATION  OF  AIRCRAFT  TARGET  MOVEMENT 


Figure  2.-  Mean  separation  time  and  range  about  mean  separation  time  between 
aircraft  targets  at  the  MAP  by  path  combination. 
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RANGE  ABOUT  MEAN  SEPARATION  BETWEEN 
TARGETS  IN  SECONDS 


RANGE  ABOUT  MEAN  TIMES  IN  SECONDS 


□  NO  WIND 


»-v  w-o  v-A  V-P  V-M 

PATH  COMBINATION  OF  AIRCRAFT  TARGET  MOVEMENT 


Figure  3.-  Average  range  about  mean  separation  time  between  aircraft  targets 
at  the  MAP  by  path  combination  and  wind  condition. 
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ABSTRACT 


This  paper  reviews  the  results  of  driving  simulator  and  in-vehicle  field 
test  experiments  of  alcohol  effects  on  driver  risk  taking.  The  objective  was 
to  investigate  changes  in  risk  taking  under  alcoholic  intoxication  and  relate 
these  changes  to  effects  on  traffic  safety. 

The  experiments  involved  complex  15  minute  driving  scenarios  ret^uiring 
decision  making  and  steering  and  speed  control  throughout  a  series  of  typical 
driving  situations .  Monetary  rewards  and  penalties  were  employed  to  simulate 
the  real-world  motivations  inherent  in  driving.  A  full  placebo  experimental 
design  was  employed,  and  measures  related  to  traffic  safety,  driver/vehicle 
performance  and  driver  behavior  were  obtained. 


Alcohol  impairment  was  found  to  increase  the  rate  of  accidents  and  speed' 
ing  tickets .  Behavioral  measures  showed  these  traffic  safety  effects  to  be 
due  to  impaired  psychomotor  performance  and  perceptual  distortions.  Subjec¬ 
tive  estimates  of  risk  failed  to  show  any  change  in  the  drivers'  willingness 
to  take  risks  when  intoxicated. 


IHTRODUCTION 


Alcohol  has  been  shown  to  be  overrepresented  in  accident  statistics 
(Refs.  1  and  2).  Recent  svirveys  have  subdivided  accident  causation  into  a 
variety  of  factors  including  vehicle,  environmental  and  driver  factors 
(Ref.  5).  Driver  behavior  can  be  further  subdivided  roughly  into  percep¬ 
tion,*  psychomotor  skill  and  higher  cognitive  factors  including  decision 
making.  Alcohol  effects  on  driver  psychomotor  skill  in  steering  control 
have  been  previously  studied  in  some  detail  (Ref.  ^),  and  the  objective  of 
the  work  reported  here  was  to  investigate  the  alcohol  impairment  in  driver 
decision-making  situations . 


*This  work  was  supported  by  the  Office  of  Driving  and  Pedestrian  Research, 
National  Highway  Traffic  Safety  Administration,  Department  of  Transportation. 
The  views  expressed  in  this,  caper  are  those  of  the  anthoT-s  and  do  not  neces  ¬ 
sarily  represent  those  of  the  National  Highway  Traffic  Safety  Administration. 
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An  important  aspect  of  this  research  -was  to  determine  whether  driver 
taking  changes  with  Blood  Alcohol  Concentration  (BAC)  and,  further,  to  parti¬ 
tion  the  changes  in  risk  taking  into  changes  in  driver  perception,  psycho¬ 
motor  factors  and  the  acceptance  of  risk.  These  three  factors  combine  to 
determine  performance  in  a  decision-making  task  and,  singly  or  in  combination, 
give  rise  to  performance  that  we  objectively  observe  as  risk  taking.  Take, 
for  example,  the  situation  where  a  driver  has  run  a  red  light.  This  could  be 
due  to  the  driver’s  having  misperceived  his  speed  or  the  time  interval  of  the 
amber  light;  it  could  also  be  due  to  the  fact  that  he  took  too  long  in  making 
a  decision  anti  thus  his  reaction  time  for  accelerating  or  braking  to  a  safe 
stop  was  delayed;  or  the  driver  may  merely  have  elected  to  accept  the  risk  of 
running  a  red  light  because  he  was  motivated  to  minimize  the  delays  caused  by 
stopping . 


In  previous  research  on  driver  risk  taking,  no  consistent  approach  has 
been  used  to  differentiate  between  the  various  factors  contributing  to  deci¬ 
sion  task  performance .  Several  studies  have  measured  driver  risk  taking, 
which  has  been  found  to  increase  with  BAC  (blood  alcohol  concentration) 
(Refs.  5”7)  .  More  recently,  however,  it  was  found  in  a  gap  acceptance  tasic 
using  significant  rewards  and  penalties  that  intoxicated  subjects  did  not 
consciously  accept  greater  risks  (Ref.  8) .  Impaired  psychomctcr  skill  did 
result  in  degraded  performance,  however. 


The  inconsistency  in  past  research  has  been  in  the  definition  and  simula¬ 
tion  of  driver  risk  taking,  the  analysis  of  all  behavior  components  in  risk 
taking,  and  the  use  of  tangible  risks.  Based  on  a  review  of  the  literature, 
the  following  elements  were  felt  to  be  essential  to  adequately  determine  the 
effects  of  alcohol  on  driver  decision  making:  1 )  division  of  driver  behavior 
into  perceptual,  psychomotor  and  cognitive  components;  2)  use  of  rewards  and 
penalties  to  simulate  real-world  risks  (e.g.,  accidents,  tickets,  lost  time); 
5)  use  of  tasks  which  simulate  the  temporal  pressure  of  normal  driving.  The 
experimental  methods  for  accomplishing  these  goals  are  discussed  below . 


mmMENTAL  METHODS 


Approach 

This  research  was  accomplished  in  two  separate  experiments,  the  first  a 
simulator  study  and  the  second  involving  field  validation  trials.  The  two 
experiments  were  designed  to  be  as  similar  as  possible  in  order  to  allow 
direct  comparison  of  results .  The  specific  setup  for  each  was  as  follows . 

Simulation.  The  simulation  was  configured  to  present  a  plausible  driving 
scenario,  requiring  both  steering  and  speed  control  in  driving  decision¬ 
making  situations .  The  functional  details  of  the  simulstion  have  been  des- 
pj'QYXously  (Ref.  9) •  Basically,  the  simulator  consisted  of  an  actual 
car  cab  and  controls  with  a  two  lane  roadway  drawn  on  a  0.25  x  0.^2  m 


(10"  X  12")*  CBI  mounted  on  the  cab  cowl  0.76  m  (JO  in.)  in  front  of  the 
driver  as  illustrated  in  Pig .  1 .  Equations  of  motion  for  the  car  steering 
and  speed  control  were  solved  on  an  analog  computer,  which  generated  car 
heading  angle,  lateral  position,  and  forward  speed  in  response  to  steering 
wheel,  accelerator  and  brake  commands .  The  car  motion  variables  drove 
special  purpose  electronic  circuits  which  generated  a  dashed  line  two  lane 
roadway  [5.65  m  (12  ft)  lane  width]  with  O.76  m  (2.5  ft)  shoulders.  The 
roadway  was  presented  in  correct  perspective,  but  reduced  scale  (roughly 
two-thirds)  in  order  to  fit  on  the  CBI  and  yet  subtend  a  22  degree  percep¬ 
tual  field  of  view. 

Driving  events  were  controlled  by  a  paper  tape  programmer  at  a  rate  pro¬ 
portional  to  forward  speed.  From  a  cross  section  of  the  many  typical  driving 
decision-making  situations  three  events  were  selected  that  could  be  easily 
implemented  in  a  laboratory  sim\ilation.  The  functional  details  of  each  event 
and  related  measurements  are  described  further  on. 

Field  Validation.  This  study  was  conducted  in  an  instrumented  vehicle 
described  elsewhere  (Ref.  IO).  Special  equipment  was  added  to  allow  the  car 
to  interact  with  the  test  course.  A  photo  detector  mounted  on  the  vehicle 
sensed  reflective  strips  on  the  test  course  and  triggered  a  programmer  which 
controlled  event  sequences  in  the  field  course  driving  scenario.  Instrumen¬ 
tation  was  also  added  to  allow  experimenter  feedback  in  scenario  conditions 
and  subject  progress.  Details  of  the  field  setup  are  illustrated  in  Fig.  2. 


Driving  Tasks  and  Measurements 

The  driving  scenario  was  designed  to  allow  implementation  both  in  the 
simulator  and  on  the  field  course.  A  variety  of  events  were  considered,  and 
events  that  could  be  conveniently  mechanized  were  selected  for  each  experi¬ 
ment  as  indicated  in  Table  1  (Ref.  H).  A  signal  light  situation  was  selected 
as  a  classical  single  stage  decision  event.  Vehicle  control  in  a  curve  was 
selected  to  investigate  the  large  number  of  single  vehicle  loss  of  control 
accidents  that  occur  with  alcohol  involvement  (Ref.  12).  The  remaining 
situations  selected  from  Table  1  involve  divided  attention,  a  driver  behav¬ 
ior  factor  which  has  been  shown  to  be  sensitive  to  alcohol  inpalrment  (Ref. 

1 5) .  Details  of  the  driving  tasks  and  overall  scenario  were  as  follows . 

Signal  Light.  A  model  signal  light  was  mounted  directly  above  the  hori¬ 
zon  of  the  roadway  display  in  the  simulator  (Fig.  la),  and  an  act\jal  signal 
light  was  set  up  on  the  test  course  in  the  field  validation  study  (Fig.  2a). 
Signal  timing  was  controlled  as  a  function  of  car  speed  and  distance  from  the 
intersection  in  order  to  control  the  time-to-go  to  the  intersection.  Several 
timing  conditions  were  used  ranging  from  a  sure  stop  to  a  sure  go.  Details 
of  the  signal  timing  and  task  kinematics  have  been  presented  elsewhere  (Ref. 
11). 

*riig-h.r.ma-ry  units  Were  used  for  the  measurements  and  calculations  of  this 
study . 
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F5.gure  1  .  Simulation  Setup 
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Figure  2.  Equipment  Setup  for  the  Field  Validation  Study 
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Driving  Scenario  and  Revard/?eaalty  Structure 

Each  run  in  the  siffiulator  and  field  tests  consisted  of  an  approximately 
15  minute  drive  which  included  a  pseudo-random  sequence  of  the  above  tasks. 
Program  starting  points  were  varied  and  counterbalanced  between  subjects  in 
order  to  avoid  learning  the  eVent  sequences .  Circuits  for  detecting  red 
light  and  speeding  violations  were  activated  at  approximately  30  percent  of 
the  events  to  simulate  occasional  police  surveillance . 

Audio  alarms  were  activated  when  violations  were  detected,  and  when  the 
lateral  g  limit  for  loss  of  control  was  exceeded  in  the  field  test.  A  crash 
buzzer  was  activated  in  the  simulator  when  subjects  exceeded  the  road 
shoulder  limits,  or  ran  into  obstacles  or  adjacent  cars.  Accidents  in  the 
field  test  were  further  defined  by  striking  the  tires  and  cones  used  to 
define  the  edge  of  the  course  (Fig.  2a).  Thus  subjects  were  giv,en  complete 
feedback  on  traffic  safety  related  variables  (accidents  and  tickets)  as 
they  would  in  the  real  world.  In  addition  the  number  of  accidents  and 
tickets  were  used  as  traffic  safety  measures  on  the  overall  driving  scenario 
and  were  also  accounted  for  in  the  reward/penalty  structure  as  described 
below . 

Subjects  were  instructed  to  behave  as  they  normally  would  in  a  driving 
situation  with  a  reasonable  motivation  for  timely  progress  while  avoiding 
traffic  violations  and  accidents.  In  addition,  the  monetary  reward/pe^ty 
structure  given  in  Table  2  was  used  to  simulate  real-world  driving  motiva¬ 
tions  and  risks  (Ref.  I^f),  and  provide  a  quantitative  value  structure  for 
expected  value  modeling  of  decision-making  behavior  (Ref.  15)*  ‘Hie  overall 


table  2.  REWARD/PEmiTY  STRUCTURE  FOR  SIMJIATIKG 
REAL-WORLD  MOTIVATIONS  IN  DRIVERS 


COMPONEMT 

lAB 

SIMOIATION 

FIELD 

VAUDATION 

Run  completion  bonus 

$10 

$10 

Time  saved  reward 

$2/min 

$2/min 

Low  ticket  penalty  group 

$l/ticket 

$1 /ticket 

High  ticket  penalty  group 

$2/ticket 

Accident  penalty 

$2/crash 

$2/crash 

Route  error  penalty 

— 

$0.50/error 
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scaling  of  the  structure  vas  made  large  enough  to  be  me^ngful  and  ccmpara- 
S  t?the  subjects-  hourly  wages.  The  run  completion  bonus  was  included  to 
insure  subjects  completing  each  run,  and  the  time  saved  reward  was  set  to 
encourage  the  subjects  to  make  timely  progress  on  the  drives  and  not  be-cme 
excessively  cautious .  Penalties  were  assessed  for  tickets,  accidents  and 
Sute  errors  (traffic  safety  factors).  Ticket  penalties  are  one  factor  that 
can  be  manipulated  in  the  real-world  (i.e.,  traffic  co^  fines)  Md  a  be¬ 
tween  group  comparison  was  included  for  two  levels  of  this  variable .  Results 
of  the  si  .ulator  study  showed  no  significant  differences  between  the  $1  and 
$2  penalty  groups  so  the  high  ticket  penalty  ’--as  increased  to  $4  for  the 
field  experiment.  Results  on  the  ticket  penalty  variation  are  fully  dis¬ 
cussed  in  Ref .  l4 . 


Design,  Treatments  and  Rrocedures 

Subiects  were  selec-ei  from  the  male  licensed  driving  population  through 
a  newspaper  ad  and  screened  to  insure  heavy  drinking  tendencies  (defined  as 
the  capability  for  reac’ning  a  peak  MC  of  0.1 5).  Based  on  age  and  scores  on 
a  hostility  test  (Ref.  l6)  and  betting  test  (Ref.  17),  suboects  were  matcned 
and  divided  into  the  two  penalty  groups.  During  training  sessions  subjects 
were  given  several  one-half  hour  exposures  to  the  simiaated  driving  scenarios 
and  reward/penalty  structure  in  order  to  minimize  learning  effects  during  the 
formal  data  sessions. 

The  experimental  design  shown  in  Pig.  3  was  completed  by  12  subjects  in 
the  simulaLr  experiment  and  at  a  later  date  by  a  different  group  of  sub¬ 
iects  in  the  field  tests.  Session  order  was  counterbalanced  between  subjects. 
Performance  was  measured  in  four  separate  runs  during  sessions  of  nomnally 
eight  hours  in  length.  During  alcohol  days  runs  were  atoinxstered  at  sober, 
ascending,  peak  and  descending  levels  of  Blood  Alcohol  Concentraoion  (BAC) 

tests.  The  sscendlng  BdC  runs  uere  s«bseque.«ly  dropsed  jn 
the  field  tests  based  on  minimal  differences  in  simulator  performance  levels 
on  the  ascending  and  descending  portions  of  ttie  BAC  curve .  0\^'^ng  P^^^ebo 

days  runs  were  administered  at  roughly  the  same  times  as  on  the  alcohol  ^ys. 
SL  subjects  served  as  their  own  controls  for  alcohol  effects,  and  penai.y 
structure  was  between  group  effect. 

Actual  times  and  blood  alcohol  levels  are  illustrated  in  Fig.  4.  BAC 
was  measured  with  a  gas  chromatograph  breath  analyzer.  Placebo  drinks  were 
mSe  by  floating  a  small  a.mount  of  liquor  on  top  of  mixer.  Subjects  were 
allowed  to  select  their  own  mixed  drinks  in  order  to  maximize  subject  morale; 
however,  combinations  which  would  not  allow  credible  ^ 

avoided.  Alcohol  was  administered  propoitional  to  body  weight  in  three  drinks. 

The  facility  layout  and  personnel  assignments  were  designed  to  maintain 
subject  motivation  and  e.xperimental  efficiency.  Recreational  areas  were  set 
up  adiacent  to  the  simulator  and  included  a  bar,  breath  test  area,  lou^e  and 
dining  area,  and  a  restroom.  This  provided  a  relaxing  atmosphere  for  the 
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subjects  between  experimental  trials  and  isolated  them  from  laboratory  acti 
vity  other  than  when  they  were  being  tested. 


EESUl/rS  AMD  DISCUSSION 


Overall  Performance 

Performance  measures  accumulated  over  the  whole  driving  scenario  ^e 
plotted  in  Fig.  5,  ’-'hich  show  excellent  agreement  between  the  simulation 
and  field  test  e.xperiments .  The  total  payoff  per  run  gives  an  overall 

combined  performance  measure  of  the  reward/penalty  structure  components 

Average  payoff  was  appreciably  affected  by  BAG  as  illustrated  in  Fig.  5  • 
Sobe^^subjLts  were  m^ng  an  average  $12.50  per  run,  which  popped  to  $p 
at  the  peak  BAG  condition.  Analysis  of  variance  procedures  (AhOV)  proved 
these  results  to  be  reliable  (P  <  0.01 ),  but  showed  no  significant 
ence  between  the  two  ticket  penalty  groups.  The  payof a.  levels  were  quite 
substantial,  as  the  average  sober  subject  made  ro-j^hlj  $50-50  d^ing  his 
placebo  session,  and  subject  comments  indicated  these  payoff  levels  moti- 

vated  performance . 

Gomponent  meas-ires  of  the  reward/penalty  structure  are  also  given  in 


was  rinarkably  insensitive  to  BAG,  while  speeding  tickets  and  accidents 
wSe  SpreciaLy  elevated  with  BAG  (Figs.  5c  and  5d)  •  Since  drivi^  com- 
pletion\ime  was  constant,  the  increased  incidence  of  speeding  tickets  with 
BAG  implies  increased  speed  variability .  Suc^ects  were  rfel-  aw<^e  of  t..e 
^led  limit  and  speeding  penalty,  and  feedback  of  speed  was  available  both 
vfsSlly  and  aurally.  Thus,  increased  speed  variability  suggests  decrements 
in  perception  and/or  speedometer  monitoring. 

Gonsidering  a  speed  versus  accuracy  paradigm,  it  is  apparent  here  that 
these  subjects  maintained  average  speed  levels  (and  thus  average  rate  of 
event  ncourrence)  under  alcohol  impairment  at  the  expense  of  accuracy 
(iSeased  tickets  and  accidents).  Thus  risk  taking  i.ncreased  «xth  BAG, 
but  the  question  remains  as  to  whether  the  drivers  were  aw^e  of  the  i 
creased  risk  and  thus  were  willingly  accepting  greater  risk. 

The  simulator  drivirig  scenario  provided  for  three  types  of  accident 
exposure,  and  these  accident  results  are  plotted  in  Fig.  6.  crashes  ^ 
the  curve  resulted  from  excessive  speed  and/or  poor  soeering  control  and 
were  the  most  prevalent  accident .  The  adjacent  car  cr^hes  arose  from  the 
l^Iver  not  monitoring  his  rearview  mirror  when  he  decided  to  steer  around 
the  obstacle  (subject  reported) .  This  result  is  consistent  with  previously 
reported  monitoring  failures  in  driving  situations  (Ref.  1;). 
during  the  experiment  indicated  that  obstacle  crashes _ occjurred  either  because 
the  driver  took  too  long  to  decide  to  stop  and  then  nit  ohe  oostacle,  or 
tried  to  steer  around  and  clipped  it  from  the  side. 


onenL  meas’xrsa  ux  Lriic  - ^  ^ 

Average  driving  time  to  complete  the  driving  scenario  (Fig 
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Figure  5.  Overall  Driving  Scenario  Performance  Measures 
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Figure  6.  Simulator  Curve,  Adjacent  Car  and 
Obstacle  Crash  Results 


The  relative  increase  in  experimental  accident  rate  with  BAC  is  compared 
with  real-world  data  (Ref*  l8)  as  shown  in  Fig.  7.  Although  there  is  some 
difference  between  the  two  experiments  reported  here  (primarily  due  to  dif¬ 
ferent  placebo  accident  rates),  the  data  are  still  consistent  with  epidemio¬ 
logical  statistics.  The  knee  of  the  experimental  data  occurs  in  the  region 
of  0.10  BAC  and  the  data  bracket  the  real-world  rates.  This  data  thus  lend 
credibility  to  alcohol  sensitivity  of  our^  simulated  driving  scenarios . 

Signal  Light  Behavior 

The  probability  of  going  on  a  given  signal  timing  condition  and  the 
driver's  estimate  of  failure  (i.e.,  running  the  red  light)  are  plotted  in 
Fig.  8.  There  were  5  signal  timings  randomly  distributed  throx;ighout  the 
scenario,  and  the  amber  light  timing  was  set  to  change  the  light  when  the 
driver  was  3  .4  seconds  from  the  intersection  (traveling  at  constant  speed) 
in  the  simulator  and  4.2  seconds  in  the  field  test  for  the  data  illustrated. 
The  amber  light  interval  was  only  3  seconds  long  so  the  subjects  would  invari¬ 
ably  run  the  red  light  under  these  conditions  if  they  decided  to  go.  There 
was  some  probability  of  going  under  this  condition,  however,  which  increased 
alcohol  c 
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Relative  Hazard  *  Relative  Probability  of  Involvement 
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Figure  ?.  Comparison  of  Experimental  Accidents 
With  Real  World  Data  (after  Hurst,  Ref.  l8) 
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Figure  8.  Signal  Light  Behavior  Probability  of  Going  am 
Estimates  of  Failure  (Punning  the  Red  Light)  Given 


go  ®ftimates  of  failure  given  that  they  decided  to 

go,  SP^F/G},  are  consistent  with  the  probability  of  going  In  the 
experiment  variability  in  the  estimates  increased  with  MC .  If  ve  hyDothe 

bility  leads  to  an  increased  probability  of  going.  In  the  field  test  a 

combination  of  increased  variability  and  lower  San  estiStfS  riS  iL  to 
increased  probability  of  going.  <-unate  oi  risjc  led  to 

failure  probability  estimates  were  obtained  as  soon  as 
whe^  passing  through  the  intersection  on  randomly  selected  events 

/  time).  In  order  to  check  for  performance  biasins- 

iepSSi^set  influenced  by  events  after  the  decision  point),  a 

senate  set  of  runs  were  conducted  in  the  simulation  where  the  whole  road- 
sipal  light  were  blanked  at  the  end  of  the  amber  light 
estimates  were  no  different  under  these  circumstances  tLn 
wh^  the  task  was  carried  to  completion.  These  results  indicate  that  the 
failj^e  estimtes  were  a  reflection  of  the  drivers-  perceptiof or  5?LSt" 

lia^ranrth  relationship  existing  at  the  appearance  of  the  ambS 

li^ht  and  the  decision  pjint.  These  points  and  a  complete  decision  the^rv 
analysis  of  the  signal  light  behavior  is  given  elsewhere  (Ref,  I5) . 

Brake  response  time  on  the  signal  light  task  was  used  as  a  measure  of 
signal  task  psychomotor  behavior  .  The  results  in  Fig  9  sSw  ^ 

alcohol  on  either  the  mean  or  variability  in  respoSf  tLe 


Figure  9.  Alcohol  Effects  on  Brake  Response  Time 
in  the  Signal  Light  Task 


624 


Curve  Beliavior 


Drivers  had  to  carefully  control  speed  on  the  curves  to  avoid  loss  of 
contrS  As  illustrated  in  Fig.  10,  drivers  did  maintain  safe  speeds  on^ 
aSe  vith  no  significant  effect  due  to  BAG  level.  However,  speed  varia- 
hility  between  curves  (computed  across  several  repeat  curves/run/subject) 
sLSncS^tJy  increase  under  peak  BAG.  ANOV  procedures  showed  this 
Sfeci  S  bHignificant  at  the  0.05  level.  By  taking  into  account  the 
speed  mean  and  standard  deviation  values  and  assuming  a  normal  distribution, 
wfSn  compute  the  probability  of  exceeding  the  critical  cu^e  speed,  which 
sLSd  equil  the  probability  of  crashing.  In  Fig.  11  comput^  and  meas^ed 
jSSed  Stabilities  for  the  simulator  data  are  compared,  computed 

probabilities  show  an  increase  in  the  region  of  peak  BAG,  but  are  gener^y 
lower  tten  the  data  by  50  percent.  In  the  field  test  Vne  mean  and  varia¬ 
bility  does  not  explain  the  increase  in  accident  rate  (field  accidents  were 
primarily  due  to  g  limit  exceedences  in  the  curves).  However,  experimenters 
SSd  tSt  g  excefdence  often  occurred  with  steering  corrections.  Steering 
actions  by  the  driver  can  exceed  the  g  limit  at  speeds  below  the  critic 
actions  oy  region  of  tire  force  characteristics,  lateral  accelera¬ 

tion  for  a  neutral  steer  car  can  be  expressed  approximately  as  a  flection  of 
SScS's  speed  (Uo),  wheelbase  (a  +b),  and  front  wheel  steer  angle,  S^. 


^  a  +  b  ^  ^max 

The  driver  could  enter  a  curve  and  establish  safe  steaay-state  conations 
(i  e  constant  Uo  and  6w),  then  provide  steering  correc^ons  which  comand 
iaterii  aSelerations  beyond  the  acceleration  limit  according  to  the  above. 

S  nSd!  S  Sgher  th/speed  (U<,),  th.  l.sd  f “f 

h<»  tolerated  before  the  tires  reach  their  acceleration  limit.  Errors  in 
?Jifmodf  might  result  from  the  driver  not  establishing  a  large  enough  steer- 
iS  angle  at^the  beginning  of  the  curve,  then  having  to  make  a  correction  in 
midcourse  which  is  beyond  the  acceleration  limits  of  the  tires . 

Subiective  estimates  of  risk  or  'crash*  probability  were  obtained  in 
Kn+Vi  -studies  at  the  end  of  selected  curves.  No  effect  of  alcohol  was  noted 
ofttS  dpitd  of  the  Inoreao.d  aeeident  rate  under 

alcohol  which  was  primarily  due  to  loss  of  cOTtrol  on  curves,  ivers 
not  exhibit  any  perception  of  the  elevated  risk. 
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Figure  10.  Mean  and  Variability  of  Speed  on  Curves 
in  the  Simulator  and  Field  Driving  Scenarios 


626 


Probability 
of  Crash 


Fig'iire  11  .  Comparison  of  Actual  and  Computed  Curve  Crash  Probabilities 
for  the  Simulator  Driving  Scenario 


SUMMARY  ARD  C0NCLUDII5G  REMARKS 


Overall  performance  on  the  driving  scenario,  as  measured  by  accumulated 
payoff  according  to  a  revard/penalty  structure,  was  appreciably  degraded  by 
BAG  (bleed  alcohol  concentration) .  Penalties  due  to  accidents  and  speeding 
tickets  increased  with  BAG  and  were  primarily  responsible  for  the  decline 
in  payoff. 

Increased  speed  variability  under  alcohol  was  responsible  for  the  in¬ 
crease  in  speeding  tickets  and  curve  accidents.  On  the  average  drivers  did 
not  perceive  the  increased  hazard  of  the  curve  task  with  alcohol  impairment 
as  indicated  by  subjective  estimates  of  risk;  however,  speed  variability  did 
increase,  probably  due  to  impaired  perception  of  speed.  Similarly,  going 
behavior  on  the  signal  task  increased  under  alcohol  due  to  an  increase  in 
the  variability  of  risk  perception. 

The  above  changes  in  speed  variability  and  signal  risk  perception  with 
increased  BAG  imply  perceptual  impairment  unknown  to  the  drivers .  Alcohol 
increased  perceptual  variability  which  increased  the  driver*  s  risk  exposure. 
However,  the  mean  level  of  subjective  risk  estimates  was  \xnchanged  with 
alcohol  in  this  experiment,  which  indicates  the  subjects  were  not  aware  of 
their  increased  risk  exposure.  The  incidence  of  tickets  and  accidents  under 
alcohol,  although  increased,  was  still  a  low  probability  event  (roughly  1  .5 
and  1  incident  per  subject  per  run,  respectively,  at  the  peak  BAC  level) 
Althoiagh  degraded  psychomotor  skill  and  perception  combined  to  increase  the 
changes  of  violations  and  accidents  under  alcohol,  the  subjects  were  not 
aware  of  these  changes  in  risk. 
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ABSTRACT 


A  decision  model  including  perceptual  noise  or  inconsistency  is  developed 
from  expected  value  theory  to  explain  driver  stop  and  go  decisions  at  signaled 
intersections.  The  model  is  applied  to  behavior  in  a  car  simulaoxon  and  instru¬ 
mented  vehicle.  Objective  and  subjective  changes  in  driver  decision  making 
were  measured  with  changes  in  blood  alcohol  concentration  (BAG).  Treatment 
levels  averaged  0.00,  0.10  and  O.lU  BAG  for  a  total  of  26  male  subjects.  Data 
were  taken  for  drivers  approaching  signal  lights  at  three  timing  configura¬ 
tions.  The  correlation  between  model  predictions  and  behavior  was  highly 
significant.  In  contrast  to  previous  research,  analysis  indicates  that 
increased  BAG  results  in  increased  perceptual  inconsistency,  which  is  the 
primary  cause  of  increased  risk  taking  at  low  probability  of  success  signal 
lights. 


lOTRODDCTICM 


One  of  the  motivations  for  developing  the  driver  decision  model  described 
here  was  to  measure  and  analyze  the  behavior  of  alcohol-impaired  drivers.  We 
desired  to  separate  risk  taking  into  components  of  risk  perception  and  accept¬ 
ance.  If  a  driver  takes  increased  risks,  is  it  because  he  perceived  the  risii 
Sn3”decided  to  accept  it  or  because  he  does  not  perceive  the  increased  risk? 
Expected  value  theory  provides  a  simple  constmxct  for  making  this  distinction 
and  has  been  applied  in  the  past  to  describe  inpaired  driver  behavior,  (Refer¬ 
ences  1,2,  and  5). 


Here  we  apply  a  Subjective  Expected  Value  (SEV)  model  to  explain  driver 
stropping  and  going  behavior  at  signaleo.  intersections.  Perceptual  noise  is 
included  to  reflect  one  type  of  driver  inconsistency  in  the  decision-making 
process  (Reference  5)«  The  model  is  applied  to  data  collected  as  part  of  an 
automobile  simulator  study  involving  a  typical  drive-home  scenario.  Although 
measures  were  taken  throughout  the  scenario  on  several  tasks,  we  concentrate 
here  on  signal  light  behavior.  We  briefly  present  the  decision  aodel,  the 
experimental  results,  and  our  analysis  and  interpretation  in  view  of  previous 


studies. 


(,3(3 


DBCISICN-MAKIIfS  MODEL 


The  model  was  derived  to  guide  experimental  design  and  measurement.  The 
expected  value  approach  is  not  new;  however,  the  inclusion  of  perceptual  noise 
as  applied  to  signal  light  behavior  is  original.  The  basic  scenario  is  a  sig¬ 
nal  light  at  an  intersection  which  has  changed  from  green  to  amber  and  will 
change  to  red  in  5  seconds.  Based  on  his  perception  of  speed  and  distance  the 
driver  must  then  decide  whether  to  stop  or  go.  The  kinematics  for  this  task 
have  been  described  previously.  Reference  h.  Here  we  briefly  derive  an  appro¬ 
priate  decision  model  subject  to  several  assunptions. 

We  begin  by  simplifying  what  is  actually  a  conplex  decision  task.  Refer¬ 
ence  11,  in  a  simple  two-alternative  situation.  Conceptually  we  are  assuming 
this  decision  process  takes  place  in  parallel  with  the  driver’s  continuous 
speed  control  behavior  as  illustrated  in  Figure  1 .  Perceptions  of  vehicle 


Figure  1.  Signal  Light  Risk  Acceptance  Model 


velocity  and  distance  to  the  signal  at  the  time  the  light  changes  to  amber  are 
used  to  form  a  subjective  estimate  of  the  probabilities  of  success  and  failure 
for  the  various  alternatives.  As  indicated  in  the  figure  and  discussed  fur¬ 
ther  below,  these  subjective  probabilities  are  stochastic  in  nature.  They 
are  weighted  with  appropriate  utilities  or  values  and  the  driver  selects  the 
alternative  with  the  highest  expected  value.  We  define  Subjective  Expected 
Values  (SEVs)  for  the  two  alternatives,  go  or  stop,  respectively: 

SEV(Stop)  =  SP(Pass/Stop)V(Pass/Stop)  +  SP(Fail/Stop)V(Fail/3top)  (l) 
SEV(Go;  =  SP(Pass/Go)v(pass/Co)  ;  SF(F(ili/Go)v(i'ail/Go)  (2) 
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where  SP(.)  and  V(»)  are  conditional  subjective  probabilities  and  values, 
respectively.  From  these  equations  and  the  several  other  simplifying  assump- 
tions,  we  can  express  the  probability  that  a  driver  will  attempt  to  go  through 
the  signal  light.  Further  simpliiying  notation  so  that  F  =  Fail  and  G  =  Go, 
the  probability  of  Going  is: 

P(G)  =  JJ"  f[3P(F/G),  SP(F/S]  dSP(F/G)  dSP(F/S)  (5) 

Region 


where  the  region  is  defined  by: 

P(G)  =  P[SEV(G)  >  SEV(S)] 


(M 


With  the  assuirjitions  listed  in  Table  1,  it  can  be  shown  (see  Reference  6 
for  derivation)  that  the  P(G)  is  the  Gaussian  integral: 


P(G)  = 


'^SP(F/G)  o 


/■SP,(F/C)  ^^|-[sp(F/0)  -  SP(r/G)i^| 
'  2a^P(F/G)  ‘ 


TABLE  1 .  SOME  MODEL  ASSUMPTIONS 


1.  Operator  selects  decision  alternative  with  largest  subjective 
expected  value.  Values  reflect  utilities  and  are  constant. 

2.  Subjective  probabilities  are  mutually  exclusive  and  exhaustive. 

3.  Subjective  probabilities  are  Gaussian  random  variables  in  the 
region  of  interest. 

h.  Increased  SP(f/g)  decreases  P(G),  i.e.,  the  values  discourage 
go-fail\ires, 

5.  The  verbal  estimates  of  SP(F/G)  linearly  reflect  subjective 
perception, 

6.  The  threshold  value  of  SP(F/G),  below  which  the  operator  selects 
the  go  alternative  is  SP^(f/G): 

•  =  SP(F/G)  where  P(G)  =0.5 

•  is  a  constant  as  compared  with  being  a  random  variable 

7.  SP(F/S)  =*0. 
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A  typical  example  of  these  concepts  is  illustrated  in  Figure  2.  Repeated 
observations  for  a  given  situation,  e.g.,  signals  with  the  same  time  to  the 
intersection,  result  in  a  distrilwition  of  subjective  estimates  illustrated  by 
CO  density  curve.  Assuming  a  cutoff  subjective  probability 

Po(F/G),  as  illustrated,  the  area  under  the  density  curve  and  to  the  left  of 
tte  criterion  is  P(G).  This  is  illustrated  in  the  bottom  of  Figure  2,  where 

^  function  of  the  average  subjective  estimate, 
bP(P/G;,  IS  illustrated.  The  slope  of  this  relationship  is  determined  by  the 
variability  of  the  subjective  estimates,  asp.  Note  that  the  effect  of  increas¬ 
ing  the  variance  of  the  subjective  estimates  is  to  increase  P(G)  for  the  case 
Illustrated.  Also  shown  is  the  consequence  of  a  change  in  the  driver's  risk 
acceptance,  SP(,(f/G). 


SPe(F/6) 


Figure  2.  Typical  Relationship  Between  Probability  of  Going  P(G) 
Subjective  Probabilities  of  Fail  Given  a  Go,  SP(F/G)’  ’ 

and  Signal  Timing  *  ' 
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A  useful  empirical  relationship  is  also  apparent  in  Figure  2,  Evaluation 
of  Eq.  f  for  the  condition  SPq(f/G)  =  SP(f/G)  results  in  P(g)  =  0.^,  Thus,  the 
subjective  cutoff  SPc(F/G)  can  be  determined  empirically  from  objective  behav¬ 
ior  probabilities  by  selecting  the  value  of  SP(F/G)  at  P(G)  =  0.5. 


THE  EXPERIMERIS 


The  signal  light  task  was  simulated  in  both  a  fixed-base  simulator  and 
instrumented  vehicle  on  a  closed  course  as  described  in  the  conqjanion  paper 
(see  Reference  ll-).  The  signal  light  timing  was  controlled  similarly  in 
both  simulation  and  field  studies.  When  the  vehicle  approached  the  inter¬ 
section,  the  signal  light  initially  turned  green.  At  a  random-appearing 
time  later,  the  signal  turned  amber.  This  time  was  controlled  by* a  circuit 
which  compensateu  for  c:r  speeu  such  that  the  time  interval  to  the  inter¬ 
section  was  the  same  for  a  given  intersection  type,  regard! .ss  of  the  approach 
speed,  if  the  driver  maintained  that  speed.  The  amber  light  interval  was 
fixed  at  3  seconds,  following  which  the  light  turned  red.  Thus,  the  proba¬ 
bility  for  successfully  making  a  light  was  controlled  without  placing  an  arti¬ 
ficial  speed  restriction  on  the  subject.  Five  signal  timings  were  automaticlly 
commanded.  One  was  set  to  require  a  sure  stop  (early  yellow)  and  another  a 
sure  go  (long  green).  The  remaining  three  timings  ranged  from  a  probable  stoo 
to  a  probable  go.  The  times  to  the  intersection  from  the  amber  light  typically 
ranged  from  2.0  to  3-5  seconds.  (The  kinematics  of  stopping  or  going  for  these 
timings  are  discussed  more  fully  in  Reference  l+.) 

The  subjects  were  instructed  to  behave  as  ihey  normally  would  in  a  driving 
situation  with  a  reasonable  motivation  for  timely  progress  and  a  desire  to 
avoid  tickets  and  accidents.  Also,  a  monetary  incentive  structure  was  pro¬ 
vided  as  a  tangible  and  quantifiable  motivation  for  performance  (see  Refer¬ 
ence  14). 

Subjects  were  trained  until  objective  performance  and  subjective  estimates 
were  consistent  in  the  view  of  the  experimenter.  Subjective  estimate  train¬ 
ing  began  with  a  short  tutorial  written  exam  used  as  a  basis  for  discussion 
of  the  concepts  of  probaoilities.  Following  this,  each  subject  received  two 
to  three  hours  of  practice  driving  in  half-hour  sessions  spread  over  two  days. 
Feedback  on  performance  and  subjective  estimates  was  given  throughout  these 
training  trials. 

Subjects  completed  trials  on  each  of  two  days.  During  an  alcohol  day 
the  trials  corresponded  to  an  across-subject  average  blood  alcohol  concentra¬ 
tion  (bag)  of  0.00  (baseline),  0.10  (ascending  —  when  measured),  0.1^  (peak), 
and  0.10  (descending).  During  the  placebo  day,  the  trials  were  given  at  ’ 
approximately  the  same  time  of  the  day  as  for  the  above  trials.  The  day  order 
was  counterbalanced  among  subjects. 

Objective  and  subjective  measures  were  taken,  and  the  number  of  stop  and 
go  decisions  was  recorded.  The  number  of  failure?  and  successes  for  each 
decision  was  detected  automatically  and  recorded  irrespective  of  whether  or 
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not  the  driver  received  a  ticket.  Corresponding  subjective  estimates  «ere 
JeLrded  dSng  Se  run.  Subjects  were  asked  to  give  their  estimate^ of  fail- 
ure  on  a  scale  of  0  to  100  percent  immediately 

intersections.  Nominally,  six  of  each  type  of  intersection  . 

Intersections  for  which  the  driver  received  a  ^^nored.  (A  tac 

a<5<!iiiTtntiQn  in  using  subjective  estimates  received  after  the  execution  of  the 
sieS  task  is  that  the  subjective  probabilities  were  unbiased  by  perfo^nce 

"luZloTe%lT^e^  SefLKcSf  IntSs^cfionfwhe're'^e'^^^^^^  -s 

S  hL  for  those  selected  Intersections.  These  results  .ere  suni- 

lar  to  the  "after  the  fact"  estimates.) 

BESUI/TS 


The  data  were  examined  for  each  intersection  independently  over  the  eight 
trial  conditions  (four  trials  per  session  for  placebo  and  alcohol  sessions). 
Both  objective  and  subjective  data  were  analyzed  to  differentiate  between 
changes  in  risk  acceptance  vs.  risk  perception. 

In  Figure  3  the  objective  probabilities  of  going,  P(G),  and  failing 
given  a  go  P(F/G),  for  both  the  simulation  and  field  test  are  conpared  to 
ttZminl  driver  risk-taking  behavior.  The  probabilities  were  confuted  by 
dividing  the  total  number  of  outcomes  by  the  total ^nmber  of 
^e  g.  P(P/G)  =  Number  of  go  failures /Number  of  go  s).  For  ex^le.  Inter 
section  2  in  the  simulation  resulted  in  the  subjects  always  "  > 

S  the  timing  was  such  as  to  preclude  go  failures,  P(F/G)  =0.  T^® 

also  adequate  on  Intersection  3  to  allow  safe  go’s;  however,  in  this  case  the 
drivers  did  not  always  go,  i.e.,  P(G)  =  0.75.  This  behavior  was  not  sensi- 
tive  to  alcohol,  and  the  subjects  appear  to  have  been  behaving  conservatively 
on  Intersection  3-  Subjects  did  not  go  very  frequently  on  Intersection  U  and 
had  a  high  failure  rate  when  they  did.  There  is  an  indication  of  increased 
go  behavior  under  alcohol  for  Intersection  U.  This  is  also  apparent  for  all 
the  intersections  in  the  field  test. 

Part  of  the  reason  for  this  increased  going  behavior  on  seme  intersection 
timing  in  spite  of  increased  failures  is  illustrated  in  Figure  U.  Here  we 
note  that  the  variability  of  the  subjective  risk  perception,  agp,  increases 
although  the  average  perception  of  risk,  SP(P/G),  remains  relatively  constant. 
CoSidfring  a  typiLl  switching  criterion,  as  shown  in  Figure  k,  we  see  that 
the  increafed  variability  of  risk  perception  with  increased  alcohol  leads  to 
a  greater  percentage  of  subjective  estimates  below  this  criterion.  The  just  - 
fication  for  this  interpretation  was  validated  via  statistical  analysis  of 
parameters  for  the  proposed  model. 
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Alcohol  Trial  Sober  Ascending  Peak  Descending 

Figure  U.  Changes  in  Subjective  Estimates  of  the  Probability 
of  Failure  Given  a  Go  Attempt,  SP(F/G)  with  BAC  Condition 


MODEL  EVALUATICn 


The  decision-making  model  discussed  above  was  used  to  analyze  driver  risk 
acceptance  behavior.  This  was  accomplished  in  three  steps.  First,  driver 
risk  acceptance  thresholds,  SP^CF/G),  were  computed  for  each  experimental 
treatment.  Then  the  threshold  data  were  analyzed  to  investigate  changes  under 
intoxication.  Finally,  the  various  risk  perception  data  were  combined  accord¬ 
ing  to  Eq.  5  and  resulting  computed  or  estimated  values  of  the  probability  of 
going,  P(G),  were  compared  with  actual  P(G)  data  to  establish  model  validity. 

Risk  acceptance  thresholds  were  conputed  for  each  subject  and  each  run 
by  cmrve  fitting  a  risk  acceptance  function  (Figure  5)  to  P{G)  and  SP(F/G) 
data  for  the  three  intersection  timing  conditions.  A  trigonometric  functlun 
was  used  to  describe  the  risk  accert'nce  function: 

P(G)  =  -L  1  +  _SP<,(F/G)]  (6) 
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Figure  5.  Alcohol  Effects  on  Signal  Light  Decision  Making  Behavior 


By  rearranging  this  formula  we  obtain  a  relationship  which  can  be  used  for 
a  linear  regression  fit: 


a^i(F/G)  -  aSPc(F/G)  =  sin”^  [2Pi(G)  -  l] 


(7) 


kr;.:  if”-  ssn/srs?  s  ?rr,sr;^. 

portional  to  the  risk  perception  variability  Ogp. 

The  SPo(F/G)  were  computed  and  analyzed  with  no  indication  of  alcohol 
oriiS  risk  ac5pta„=e.  The  |P  and  SP(F/0)  tota  .era  tten 
•hn  r*rmmute  'orobability  of  go  estimates ^  P(G)y  according  to  5* 

LmpaS  favorably  as  Lown  in  Figure  6.  An^ysis 

were  employed  to  compare  the  actual  and  estimated  values  of  P(G).  The  F 
ratios^ndicated  that  P(G)  was  highly  correlated  with  the  computed  es-ima  e 

f‘(G),  Reference  6. 

These  -esults  suggest  that  the  alcohol  effects  on  the  fivers'  subjective 

risk  perception,  both®SP(F/G)  and  asp,  are  J"%J°^„j!JSSsro?Se 

going  behavior  while  intoxicated.  They  also  validate  the  usefulness  of  the 

model  in  analyzing  that  behavior. 

There  are  other  possible  interpretations  of  these  results.  An  intuitive 
,-t  the  va-riations  in  Subjective  estimates  are  due  to  variations  in 

thS  time  of  the  decision  and  not  to  variations  in  perception  for  a  given  time 
and  distance  relation.  However,  a  preliminary  analysis  of 

for  several  of  the  subjects  indicated  that  the  response  times  did  not  change 
significantly  under  alcohol.  Reference  7.  In  addition,  there  are  other  models 
which  could  be  applied  to  the  observed  signal  light  behavior.  A  potentially 
fruitful  approach^is  the  signal  detection  model  as  devel^ed  by  Green  and  Swets, 
Reference  8  expanded  for  application  to  man/vehicle  problems  by  Cu^,  et  al.. 
Reference  9  and  applied  to  the  lane  change  maneuver  by  Cohen  and  Ferrell,  _ 
Reference  10.  Other  types  of  criteria  suggested  in  this  work,  such  as  likeli¬ 
hood  rSio  threshold  aS  Ne^gman-Pearson  strategy,  may  be  applicable.  Hoyer, 
it  is  annarent  from  Figure  6  that  the  additional  refining  assumptions  ^ed  in 
Jhe^  SrLf not  bf^ecessary  for  interpreting  the  major  effects  of  alcohol 

on  decision  behavior. 


PREVIOUS  RESEARCH 


While  increasing  frequency  of  driving  decision  errors  with  increased  ^ 
BAC  his  been  found  by  other  researchers,  the  interpretation  of  which  behavior 

component  is  primarilyesponsib™ 

SrSnd  SSty  Snfirio;:,''aicohol  treatment  methods,  and  analytical 
approaches.^  Ilcwcver,  the  results  can  be  interpre-c^  and  Couipareu  aa  aoxxow;,. 
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Dearnaley,  and  Hansel,  R  >  -Pniind  the  number  of  attempts  increased 

drive  through  a  cone-delineated  |^P  ^  Reference  11  using  a  simulated  traf- 
with  alcohol  intake.  !fieSons2  sISificktir  iLreased  under 

fic  signal,  found  the  num  e  ®  found  an  increased  number  of 

alcohol.  Light  and  Keeper,  Reference  12  also  found^a 

attempted  passes  in  a  Simula  T,„f..j.p„ce^1'5  in  evaluating  performance  on 
stad,  McFarling,  and  Struckman,  ^^^^''^^^^J^v^  wi^rmultiple  discriminant 
laboratory  analogs  of  automotive  r/,:S®,S/SdSSivS  in^  -th 

analysis,  found  the  discriminant  on  passing  attempts, 

alcohol.  This  prSn^SrbJ  Sapper  aJd  EdwLds,  Befer- 

enL^o^^wS^foundVsignificant  change  with  BAC  in  the  number  of  attempted 
la"  c^Ces  JS^ough  a  liven  gap  size  on  their  closed  course. 

The  interpretation  of  these  ^^a  -  resulting^^^^^ 

measures  to  delineai;e  cnange  ^  of  confidence  expressed  as 

ence  1,  asked  the  f  -cSd  in  driving 

the  number  of  times  out  of  f  e  c‘:;+Tm&te3  did  not  change  significantly 

through  the  different  size  gaps  The  the  accepted  gap  size 

on  tbe  ...rase  f=n  tha  nar^vast  aoa^aa  tL  diffl- 

decreased  with  increased  f tecLe  more  optimistic  and  attached 
culty  of  the  task  ^emaxned  unchanged  th^  became  ^  estimates 

a  higher  subjective  probability  f  ^^^e  task  T^ 

were  not  reported.  teriorate  "■'udgme«t,"  where  we  interpret 

to  decrease  psychomo.or  skill  and  deterio^  e  -  the  other  hand, 

judgment  to  ^  luSStive'probaMlities  and  fouAd  no  significant 

asked  their  subjects  for  su  j  p^  change  in  the  mean 

change  in  the  mean  for  a  given  g  p  •  .  ‘  ,  t  with  increased  failures 

subjective  estl^tee  of  Steefli^  BAC  ,as 

In  e>“=f  i""’  .„li.  no'^dat.^n  the  effects  of  BAC  on  the  consls- 

SfcfS  fariaSfi?'  Sli;  stljeokve  proh.bUltlee  .ere  presented. 

By  oOBparisOh^  ^  findings  ag^e  .ith  nost^of^these^^s»lts^but^n^^^ 

the  authors*  interpretations,  as  in  .  ^-hanse  in  the  mean  sub- 

risk  taking  and  no  change  in  '"However,  ou^  data  suggest  that 

jective  estimate  for  ® to’ ^'ncreased  variance  or  inconsistency 
increased  risk  taking  is  Should  also  explain  the  results 

in  perceptual  estimates.  mpnSoned  above  ’f  data  on  mean  and  variances 

found  by  the  first  four  The  disparity  between  this  conclusion 

of  subjective  estimates  were  available.  The  aisp  factors.  Their 

and  Snapper  and  Edwards'  conclusion  m  y  ^  execution  than  does  the 

lajc  chjngc  reSa  w  have  beer  .ore  sensitive 

degradetlm.  In  OOT  S?vtaB 
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simulated  driving  tasks  and  those  of  both  of  the  previous  studies  using  sub- 
iective  estimates  is  addition  of  tecnporal  pressure.  Our  subjects  were  required 
to  form  their  estimates  in  "real  time"  as  opposed  to  the  'stop  action  type  of 
judgments  and  driving  scenarios  used  in  previous  studies. 

Thus  the  behavior  skills  required  for  the  decision-making  tasks  of  the 
other  researchers  are  somewhat  different  from  those  studied  here.  Allowing 
for  these  differences,  the  other  studies  may  have  had  the  same  cause  for  the 
increased  risk  taking  as  measured  here,  namely,  distorted  perception,  but  they 
did  not  present  sufficient  data  to  determine  it. 

In  summary  of  previous  decision-making  studies,  those  aspects  of  our 
results  which  are  directly  comparable  with  previous  research  largely  agree 
with  those  findings.  Risk  taking  generally  increased  with  increasing  BAC. 
Interpretation  of  previous  work  beyond  this  point  is  difficult  because  of 
insufficient  measures.  However,  that  work  does  not  disagree  with  the  ci^rent 
conclusion  that  there  is  no  change  in  risk  acceptance.  Our  interpretation 
of  these  results,  that  percentual  distortion  is  a  primary  cause  of  alcohol- 
induced  increased  risk  taking  observed  for  simple  tasks,  is  new. 


COWCLUSIONS 


An  e:<pected  value  model  accounted  for  the  effects  of  perceptual  noise 
on  decisions  for  drivers  in  a  simulated  signal  light  task.  With  this  model, 
analysis  of  the  significant  changes  in  behavior  for  increasing  BAG  indicated 
no  changes  in  risk  acceptance;  that  subjects  did  noz  cnange  uheir  subjec¬ 
tive  criterion  level.  The  primary  cause  of  the  increased  risk  taking  found 
for  intersections  timed  with  a  low  probability  of  success  v^as  increased  incon¬ 
sistency  or  variance  in  their  subjective  perceptual  estimates. 

These  results  have  ramifications  both  for  researchers  in  this  field  and 
those  attempting  to  apply  the  results.  In  future  human  decision-making  work, 
measures  of  inconsistency  in  perception  should  be  given  as  much  attention  as 
measures  of  central  tendency.  Also  suggested  by  these  results  is  that^cne 
method  of  reducing  drinking  driver  errors  may  be  to  improve  the  driver’s  per¬ 
ceptual  environment  to  decrease  his  inconsistency.  We  could  e^^ect  these 
results  to  generalize  the  effects  of  alcohol  on  other  such  real-time  decision 
tasks  as  aircraft  and  spacecraft  control.  In  addition,  the  analytical  frame¬ 
work  used  here  may  be  useful  in  evaluating  the  eifects  of  other  di*ugs  and 
stressors  on  human  decision  behavior. 
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COMBINED  MONITORING,  DECISION  AND  CONTROL  MODEL 
FOR  THE  HUMAN  OPERATOR  IN  A  COMMAND  AND  CONTROL  TASK 


by 

Ramal  Mural idharan,  Sheldon  Baron 
Bolt  Beranek  and  Newman  Inc.,  Cambridge,  MA 


SUMMARY 

This  paper  reports  on  the  ongoing  efforts  to  model  the  human  operator  in 
the  context  of  the  task  during  the  enroute/return  phases  in  the  ground  based 
control  of  multiple  flights  of  remotely  piloted  vehicles  (RPV).  This  is  a  part 
of  our  research  aimed  at  investigating  human  performance  models  and  at  m-'deling 
command  and  control  systems.* 

The  approach  employed  here  uses  models  that  have  their  analytical  bases  in 
control  theory  and  in  statistical  estimation  and  decision  theory.  In 
particular,  it  draws  heavily  on  the  models  and  the  concepts  of  the  optimal 
control  model  (OCM)  of  the  human  operator.  We  are  in  the  process  of  extending 
the  OCM  into  a  combined  monitoring,  decision,  and  control  model  (DEMON)  of  the 
human  operator  by  infusing  Decision  theoretic  notions  that  make  it  suitable  for 
application  to  problems  in  which  human  control  actions  are  infrequent  and  in 
which  monitoring  and  decision-making  are  the  operator’s  main  activities.  Some 
results  obtained  with  a  specialized  version  of  DEMON  for  the  RPV  control  problem 
are  included. 

1.  INTRODUCTION 


1.1  Modeling  Goals 

We  are  involved  in  a  program  of  research  aimed  at  investigating  human 
performance  models  and  approaches  to  modeling  command  and  control  systems  (see 
reference  1 ) .  A  part  oi  our  research  effort  concerns  the  study  of  the 
feasibility  of  modeling  the  human  operators  in  command  and  control  systems  via 
control  and  decision  theoretic  models.  This  paper  describes  the  salient  aspects 
of  this  part  of  our  ongoing  research  effort. 


1.2  Modeling  Approach 

The  approach  employed  here  uses  models  that  have  their  analytical  bases  in 
control  theory  and  in  statistical  estimation  and  decision  theory.  In 
particular,  it  draws  heavily  on  the  models  and  concepts  of  the  OCM  (references 
2-6).  The  modeling  approach  is  normative,  in  that  one  determines  what  the  human 
operator  ought  to  do,  given  the  system  objectives  and  the  operator's 


*  The  research  reported  in  this  paper  was  supported  by  the  Air  Force  Office  of 
Scientific  Research  under  contract  F44620-76-C-0029. 
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limitations,  and  this  serves  as  a  prediction  of  what  well-trained,  motivated 
operators  will  do* 

In  the  basic  OCM  concern  is  more  with  the  operator’s  continuous  interaction 
with  the  system,  as  demanded  by  closed  loop  analysis,  than  with  his  response  to 
discrete  events.  The  development  of  the  basic  OCM  and  its  model  structure  has 
been  dictated  by  the  principal  areas  of  its  previous  application,  viz.,  vehicle 
control.  We  shall  extend  the  OCM  by  incorporating  structures  and  notions  that 
make  it  suitable  for  application  to  problems  in  which  human  control  actions  are 
infrequent  and  in  which  monitoring  and  decision-making  are  the  operator’s  main 
activities.*  The  expected  end  product  is  a  combined  monitoring,  decision,  and 
control  model  for  the  human  operator  in  a  command  and  control  task. 


1*3  Task  definition 

In  this  paper  we  shall  discuss  our  modeling  effort  as  it  relates  to  the 
task  facing  the  human  operator  during  the  enroute/return  phases  in  the  ground 
based  control  of  multiple  flights  of  remotely  piloted  vehicles  (RPV). 

The  enroute/return  phases  together  with  a  terminal  control  phase 
constitute  an  "RPV  mission".  An  RPV -mission  consists  of  coordinated  flights  of 
several  RPV-triads.  Each  triad  has  a  strike  vehicle  (S),  an  electronics 
countermeasures  vehicle  (E)  and  a  low-  reconnaisance  vehicle  (L).  Each  RPV  is 
automatically  controlled  along  a  pre-programmed  flight  plan  assumed  optimal 
with  respect  to  terrain  and  defenses.  The  RPVs  deviate  from  their  flight  plan 
due  to  navigation  system  errors,  position  reporting  errors,  communication 
jamming  by  the  enemy,  equipment  malfunctions  etc.  These  devi.^lons  are  kept  in 
check  by  external  monitoring  and  control  from  the  ground  station.  This 
supervision  is  provided  by  human  enroute  controllers,  who  are  equipped  with  CRT 
displays  for  monitoring  flight  path  and  vehicle  status  and  with  keyboards  and 
light  pens  for  introducing  changes  in  RPV  flight  parameters.  The  ultimate 
objective  of  the  enroute  controllers  is  to  ensure  that  the  S  and  E  RPVs  fly  on 
schedule  over  the  target  15  seconds  apart  followed  by  the  L  RPV  two  minutes 
later  to  assess  damage.  This  time-phasing  at  the  target  is  accomplished  by 
time-phased  handoffs  at  designated  hand-off  coordinates  on  the  flight  plan.  The 
S  RPV’s  are  handed  off  to  the  terminal  controller  (pilot)  equipped  with  a 
televised  view  from  the  nose  of  the  RPV  and  with  standard  aircraft  controls  and 
displays  in  order  to  direct  each  vehicle  to  a  specific  designated  target, 
release  its  payload,  and  hand  it  back  to  one  of  the  enroute  controllers. 

Terminal  phase  control  is  achieved  only  if  the  S  RPV  is  within  a  1500’ 
corridor  around  its  flight  plan.  It  is  the  responsibility  of  the  enroute 
operator  to  command  "patches"  to  alter  the  flight  plan  as  necessary  to  achieve 
terminal  phase  control.  These  patches  are  acceptable  ("GO")  only  if  they 
satisfy  constraints  such  as  turning  radius,  available  fuel,  command  link  status 
etc. 


•  This  type  of  extension  is  feasible  because  of  the  basic  information  processing 
structure  of  the  OCM.  Indeed,  there  have  already  been  applications  of  OCM  to 
account  for  visual  scanning( references  7,8)  and  decision  making( references 
9,10). 


In  sunimary,  the  enroute  operator's  task  is  to  monitor  the  trajectories  and 
ETAs  of  N  vehicles,  to  decide  if  the  lateral  deviation  or  ETA  error  of  any  of 
these  exceeds  some  threshold,  and  to  correct  the  paths  of  those  that  deviate 
excessively  by  issuing  acceptable  patches. 


2.  THE  aOSED  LOOP  MODEL 

A  block  diagram  modeling  the  flow  of  information  and  the  control  and 
decisions  encountered  by  the  human  operator  (enroute  operator)  is  shown  in 
Figure  1, 
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Figure  1.  Block  Diagram  for  RPV  Monitoring/Control  Decision  Problem 

DCF:  The  DCF  (Drone  control  facility)  contains  the  stored  flight  plans 
that  drive  the  N  subsystems  RPY^,  i=1,2,...,N,  They  are  usually  "optimal”  with 
respect  to  current  terrain  and  other  information.  We  will  assume  they  can  be 
computed  using  state-variable  equations. 

System:  The  N  RPVs  undergoing  monitoring/control  constitute  the  system.  A 
simple  non-linear  representation  of  their  dynamic  behavior  will  be  assumed  for 
this  analysis.  Linearization  will  be  earned  out  if  necessary  for 
implementation  of  the  model.  The  true  status  x^  of  the  i-th  RPV  may  be 
different  from  the  stored  flight  plans  due  to  "disturbances"  w^.  The  reported 
status  y^  will  be  different  from  the  true  status  due  to  reporting  error  v^. 
The  observed  status  will  depend  on  the  reported  status  yi  and  on  t^e 
"monitoring  strategy"  (to  be  discussed  later  on). The  disturbances  w^  and 
reporting  error  v^  will  be  modeled  by  suitable  random  processes.  The  y^  are  the 
displayed  variables  corresponding  to  RPVj^. 
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Monitoring  Strategy:  Since  the  human  must  decide  which  RPV  or  which 
display  to  look  at,  he  needs  to  develop  a  monitoring  strategy.  This  is 
important  because  his  estimates  of  the  true  status  of  each  RPV  (and  hence  his 
patch  decision  strategy)  will  depend  upon  his  monitoring  strategy.  To  account 
for  the  interaction  of  the  patch  decision  strategy  with  the  monitoring  strategy 
we  formulate  and  solve  a  combined  monitoring  and  patching  decision  problem 
(Appendix  B  has  the  details). 

Monitoring  strategies  may  be  distinguished  by  whether  they  predict 
temporal  (time  histories  of)  monitoring  behaviour  or  average  monitoring 
behaviour  over  some  chosen  time  horizon.  Most  of  the  earlier  work  in  the 
literature,  including  that  with  the  OCM,  falls  in  the  latter  category.  The 
monitoring  strategy  we  derive  will  predict  temporal  behaviour  which  can  be 
simulated  .  Some  of  the  monitoring  strategies  derived  in  the  literature  which 
we  expect  to  investigate  in  the  DEMON  setup  are: 

(i)  A  simple  strategy  involving  cyclical  processing  of  the  various 
RPVs( reference  11). 

(ii)  A  strategy  generalizing  the  Queueing  Theory  Sampling  Model  (reference 
12),  which  would  minimize  the  total  cost  of  not  looking  at  a  particular  RPV 
at  a  given  time.  This  strategy  is  mainly  useful  for  maintaining  lateral 
deviations  within  allowable  limits.  The  costs  for  errors  and  for  the 
different  RPVs  would  be  functions  of  the  time-to-go  and,  possibly,  RPV 
type. 

(iii)  A  strategy  of  sampling  when  the  probability  that  the  signal  exceeds 
some  prescribed  limit  is  greater  than  a  subjective  probability 
threshold(references  13i1^)- 

(iv)  A  strategy  aimed  at  minimizing  total  estimation  error (reference  7). 
This  strategy  would  be  consistent  with  monitoring  for  the  purpose  of 
minimizing  lateral  deviation  errors. 


Information  Processor:  This  block  models  the  processing  that  goes  on  in 
the  human  operator  to  produce  the  current  estimate  of  the  true  RPV  status  from 
past  observed  status.  This  block  is  the  well  known  control-  theoretic  model 
consisting  of  a  Kalman  filter-predictor  which  produces  the  maximum-likelihood, 
least-squares  estimate  x  =(x^,  x^)  of  the  true  status  x  of  all  the 
RPVs.  It  also  produces  the  variance  of  the  error  in  that  estimate. (Note  that  an 
estimate  of  the  state  of  each  RPV  is  maintained  synchronously  at  all  times. 
Observation  of  a  particular  RPV  improves  the  accuracy  of  the  estimate  of  the 
status  cf  that  RPV  while  uncertainty  about  the  status  of  the  remaining, 
unobserved  vehicles  increases.)  Given  the  assumptions  generally  made  for  this 
kind  of  analysis,  the  information  processor  can  thus  generate  the  conditional 
density  of  x  based  on  the  past  observations  y. 


Decision  Strategy:  This  block  models  the  process  of  deciding  which,  if 
any,  RPV  to  patch.  We  consider  the  decision  process  to  be  discrete  (it  takes  5 
sec  to  get  a  new  display).  The  cost  of  making  a  patch  would  reflect  the  lost 
opportunity  to  monitor  and/or  patch  other  RPVs  as  well  as  break! 
radio-silence;  the  gain  (negative  cost)  is  the  presumed  reduction  in  error  for 
the  "patched”  vehicle.  The  decision  strategy  attempts  to  minimize  the 
(expected)  cost.  This  block  translates  the  best  estimate  x  into  a  decision  to 
(i)  command  a  patch  to  one  of  the  RPVs  and/or  (ii)  modify  the  future  monitoring 
strategy. 
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Patch  Command  Generator:  This  block  generates  the  commanded  patch.  We 
shall  investigate  a  strategy  based  on  minimizing  a  weighted  sum  of  the  time  to 
return  to  the  desired  path  and  the  total  mean-square  tracking  error.  The 
allowable  paths  would  be  constrained  by  the  RPV  turning  radius  limits.  Random 
execution  errors  would  be  added  to  the  commanded  patch  to  represent  human 
errors . 

Patch  Check:  This  consists  of  a  GO/NO  GO  check  on  the  patch  using 
conditions  on  turning  radius,  command  link  status,  etc. 

3.  M&TBQttTICAL  DETAILS  OF  THE  HODEL 

3.1  System 

The  system  under  study  consists  of  the  N-RPV  subsystems  and  may  be 
described  by  the  state  equations:* 

X  =  Ax  +  dBu  +Ew  +Fz  ,x(tg)  =  Xg 

where  the  state  vector  x  includes  the  states  x^  of  the  N-RPV  subsystems.  Here  d 
is  a  vector  of  decision  variables  (to  be  explained  below)  and  z  is  a  non-random 
input  vector  which  will  be  used  to  model  non-zero  means  of  the  random  inputs  w 
as  well  as  any  predetermined  command  inputs.  In  the  present  RPV  context  z  will 
be  used  to  generate  the  flight  plan  for  the  RPVs.  The  vector  u  denotes  the 
patch  control  input  to  the  RPVs.  In  partitioned  form  equation  (1)  appears  as 
follows: 
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For  the  system  under  study,  the  following  observations  hold: 

Al*  Only  one  of  the  N-RPV  subsystems  may  be  controlled  by  the 
patch-control  u  at  any  given  time.  A  decision  to  control  the  i-th  RPV  subsystem 
then  implies  the  following  conditions  on  the  decision  variables. 

di  =  1  ,  dj  =  0  ,  j  i  ^3) 

^  A2:  The  N-RPV  subsystems  are  decoupled  (except  for  the  interdependence  of 

the  decision  variables  via  (3))?  that  is, 


*  For  the  purpose  of  discussion, a  linear  model  is  assumed.  In  actual 

implementation,  we  may  use  a  simple  non-linear  model  in  which  case  (1)  would 
represent  a  linear  perturbation  equation  for  the  system  about  some  nominal 
trajctory. 
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3.2  Flight  Plan  (DCF) 

When  there  is  no  disturbance  _vf 
subsystems  follow  the  flight  plan  x 

xi  =  x^  +F^^z^,  xi(to)  =  x^ 


and  no  (patch)  control  u  then  the  N-RPV 

(6) 

using  a  piecewise 


j  .,r>  rtf  straittht  lines  are  easily  generated 
.inKan?'ume”Lnctfon  for  zi  and  xj  as  the  launch  point. 


3,3  Patching 


Any  -  i  vi 

Denoting  these  deviations  by  e  =  x 

=  A^^  e-  +  d^B^u  +  E^^w^  >  e^(to)  =  xj"*?) 

dj^  =  0  or  1 

J  di  =  1  cr  0 


(7a) 

(7b) 

(7c) 


It  is  the  purpose  of  the  (patch)  control  “at  S'^rSngl^BPV 

wi  is  an  unknown  random  ®  6^=0  for  all  i.  The  operator  thus 

f“‘’"^"tS^aJching%roblem' Which  consists  of  the  following  three  sub-problems: 

--  SI  ; -fr  TpScmitored  HPV7 

(‘ji!  Kj:rrpra«:n :  :!srpa«h  Lnan- 1.  usu.. 

3.3.1  Honitoring  Decision 

As  mentioned  before,  the  “fS 

the  patching  “*'5™%,„te«l^only  a  mjnltored  SPV  can  be  patched.  The 

Sn'e;  ^;m“%fi"and  patching  declalon  prohl«.  la  anal, ted  In  appendl.  B. 
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3*3-2  Patching  Decision 

A  patching  decision  consists  of  deciding  if  the  monitored  RPV  subsystem  is 
to  be  patched.  At  most  one  of  the  RPVs  may  be  patched  at  a  given  time.  One 
idea  of  patching  is  to  reduce  deviations  from  the  flight  plan  to  below  some 
threshold  values.  Some  facts  to  note  are: 

(i)  Cross- track  error  of  less  than  250’  is  desired  for  type-S  RPVs 
(ii)  Terminal-phase  control  not  possible  if  cross  track  error  exceeds  1500* 
We  assume  a  normative  model,  in  which  the  operator  attempts  to  optimize  some 
(subjective)  measure  of  performance  via  a  patching  decision.  This  performance 
measure  would  depend  on  his  understanding  of  the  mission  objectives.  Some  of  the 
objectives  of  the  RPV  mission  are:  Don’t  lose  an  RPV,  maintain  ETA,  maintain 
lateral  position,  maintain  radio  silence.  We  consider  two  alternative  cost 
functions  to  help  in  arriving  at  a  patching  decision: 

Piecewise  constant  cost  function 

C(ei)  =  Ci  if  e  e^,  a  threshold  set 

C(ei)  =  Ci  if  ^ 

Quadratic  Cost  function 

C(ei)  =  ei’  K 

The  choice  of  e^  and  K  will  be  made  based  on  facts  of  the  type  (i)  and  (ii) 
noted  above.  The  costs  C^,  ,  C(ei)  will  be  chosen  to  be  functions  of  mission 
time  to  reflect  the  importance  of  ETA.  As  mission  time  gets  closer  to  ETA  for 
RPV-i,  Ci  will  be  made  larger  and/or  e^  will  be  shrunk  to  reflect  "urgency". 
The  optimal  patch  decision  will  be  chosen  to  minimize  the  expected  cost  using 
subjective  probabilities  computed  with  the  help  of  the  information  processor. 
The  details  are  in  Appendix  B. 

3.3.3  Patch  Control  Computation  and  Generation 

Once  a  decision  is  made  to  patch  a  particular  RFV-subsystem,  it  is 

necessary  to  compute  and  execute  the  patch  control.  The  purpose  of  a  patch 

control  is  to  guide  the  aircraft  from  its  initial  location  and  heading  to 

intercept  and  fly  along  the  planned  flight  path.  Various  criteria  may  be 

considered  to  compute  the  optimal  patch  control,  for  example,  a  strategy  that 
minimizes  the  time  to  return  to  the  planned  flight  path  (see  appendix  A  and  also 
reference  15). 


4.  IMPLEMEMTATIOH  OF  THE  MODEL 

DEMON,  the  combined  monitoring,  decision,  and  control  model  of  the  human 
operator  is  being  implemented  in  FORTRAN.  The  program  has  a  modular  structure 
to  facilitate  ease  of  adding  further  modules  to  include  alternative  monitoring, 
control,  and  decision  strategies  that  may  appear  promising  at  a  future  date. 

To  accomodate  the  random  aspects  of  the  problem,  the  program  will  basically 
have  a  Monte-Carlo  simulation  character.  The  specialized  version  of  DEMON  for 
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seconds).  Each  RPV  is  observed  via  a  single  lateral  deviation  display  and 
controlled  via  a  constant  velocity  comand.  The  permissible  patch  back  to  the 
flight  plan  is  constrained  by  the  maximum  allowable  speed  which  represents  the 
turning  radius  constraint.  The  patch  control  strategy  is  to  use  maximum 
allowable  speed  adjusted  by  a  "safety  factor"  \diioh  depends  on  the  "NO  GO" 
patches  issued  previously  by  the  operator  for  that  RPV. 

Some  preliminary  results  have  been  obtained  using  DEMON  on  the  above 
simplified  RPV  mission.  The  flavour  of  the  results  we  obtained  is  indicated  in 
Figure  3  which  shows  the  combined  effect  of  ETA  dependent  (shrinking)  threshold 
and  different  RPV  priority  on  the  simulated  simple  RPV  mission.  As  mission  time 
increases  RPV  monitoring  frequency  increases  .  But  there  comes  a  time  when 
monitoring  resources  are  not  adequate  to  satisfy  the  increasing  needs  of  each  of 


Figure  3.  Effect  of  Shrinking  Threshold  and  RPV  Priority 

whe  RPVs  and  then  the  highest  priority  RPV  demands  most  of  the  attention  it  can 
get  while  the  lowest  priority  RPV  gets  no  attention  from  the  operator, 

6.  CONCLOSION 


We  have  developed  DEMON,  a  combined  monitoring,  decision  and  control  model 
for  the  human  operator  in  the  context  of  the  enroute  phase  of  an  RPV  mission 
Since  the  monitoring  strategy  derived  from  DEMON  is  temporal  it  has  obvious 
application  to  developing  instrument  scanning  strategy  for  flight  control  and 
management.  We  have  structured  the  model  to  have  wider  applicability  (than  the 
problems  addressed  by  the  basic  OCM  or  the  RPV  control  problem)  and  expect  it  to 
be  useful  to  model  human  operators  whose  control  actions  may  be  infrequent  but 
whose  monitoring  and  decison  making  may  be  the  primary  activities  We 
anticipate  testing  and  refining  the  DEMON  model  further  using  an  existir»r  data 
base  for  the  RPV  control  problemC reference  16).  * 
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7.  APPEBDIX  A:  PATCH  COMTBOL  STRATEGX 

7.1  Syste.  Dyna-ics  and  Patch  Ccputation 

.  ,  fv,.  K  RPV  system  dynamics  were  considered  in  general  terms. 

EL?tarp“LTe?in”-tS'te  the  nor.alUed  equations  of  .otlon  OorLoO  in 


Figure  4.  Choice  of  Co-ordinates  for  System  Equation 
relative  to  track: 

=  cos  X4  -  1  ,  xi(0)  given,  xid)  free  . 

i2  =  sin  X4  .  X2(0)  given,  X2(T)  =0 

X3  =u  sin  X4  ,  X3(0)  given,  X3(T)  =1 

..u  ,  X4(0)  given,  X4(T)  =0 

T  free 

x§  +  x4  =  1 

•-  martfo  to  natch  a  particular  RPV-subsystem,  it  is 
Once  a  decision  is  made  P  «nntrol  The  purpose  of  a  patch 

necessary  to  compute  and  execute  e  ^  initial  location  and  heading  to 
control  is  to  guide  the  Various  criteria  may  be 

SasSeo\”o  oS,’puS°tte  optlLl  patch  control.  Han,  orltorla  .a,  ho  -ritton 
in  the  ^  1/2K2  x^  dt  +  K3  dt 

which  is  a  weighted  sum  of  the  JSnned^flighf  pSh!we 

iiroS”o3^nhro^^’  f~.urrKr“  “ 

path  by  choosing  the  weights  to  be  K1-O-K2  and  113 


656 


ORIGINAL  PAGE  IS 

OP  POOR  quality 


7«2  Mininum  Time  Patch  Strategy 

Using  the  necesssary  conditions  for  minimum  time  it  is  easy  to  see  that  the 
optimal  control  is  Bang-Bang  except  for  possible  singular  arcs.  It  can  furthur 
be  shown  that  the  singular  control  is  identically  zero. 


O 

RtQht  Turn 


Figure  5*  Minimum  Time  Patch  Control  Strategy 

The  computed  minimum-time  patching  strategy  is  indicated  in  Figure  5*  For 
example,  all  points  in  state  space  that  can  be  brought  to  the  planned  flight 
path  using  a  single  left  turn  u=l  are  characterized  by  the  equation  X2(0)  =  cos 
X4(0)-l  . 

The  minimum  time  required  for  the  patch  will  be  checked  against  the 
scheduled  hand-off  times  for  the  given  RPV  to  determine  if  the  computed  patch 
should  be  executed.  Velocity  patches  to  correct  for  ETA  errors  with  due  regard 
to  fuel  constraints  may  be  included  by  a  simple  extension  of  the  above  problem 
(for  example,  append  to  the  minimum  time  patch  a  velocity  patch  to  minimize  ETA 
errors) . 

The  operator  does  not  observe  the  states  x  directly,  and  will  base  his 
control  actions  instead  on  the  best  estimates  of  these  states  available  to  him 
based  on  ail  his  observations.  This  disjoining  of  estimation  and  control  is 
justified  by  the  "separation  principle"  (see  reference  17). 

8,  APPEHDIX  B:  PATCH  DECISION  STRATEGT 

8«  1  Introduction 

In  this  appendix  we  shall  formulate  and  solve  the  combined  monitoring  and 
patching  decison  problem  encountered  by  the  enroute  operator  in  the  RPV  mission. 
As  stated  in  section  3,  the  information  processor  produces  the  current  estimate 
x"  of  the  true  status  x  of  all  the  RPVs  at  any  time.  It  also  produces  the 
variance  of  the  error  in  that  estimate.  The  information  available  for  making 
monitoring  and  patching  decisions  may  be  summarized  in  terms  of  the  posterior 
distribution  of  conditioned  on  all  observations  based  on  past  monitoring  and 
patching  decisions  and  control.  Under  the  usual  assumptions,  this  posterior 
distribution  for  xi  is  N{xi,  X^i). 
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Let  denote  a  threshold  set  associated  with  the  i-th  RPV,  that  is, 
xk  is  a  desirable  condition.  Let  Ri  denote  the  hypothesis  that  xH  and  P 
be  the  probability  that  is  true,  pi  is  easily  calculated  using  the  available 
information  on  the  posterior  distribution  of  x^; 


pi  =  1  -  N(xi  ,  Xii)  dxi 

x^ 


Monitoring  the  i-th  RPV  results  in  a  tighter  distribution  for  x^ 
vi  because  it  reduces  the  uncertainty  associated  with  x  .  Pj 


around  its  mean 
Patching  the  i-th 

RPv' rVquYres  monitoring  as  well.  The  effects  of  patching  are;  first,  to 
correct  the  error  ei  which  might  have  'wandered  off  from  xero  due  to 
M  a.5«rlns  that  t  xh  and  aeoond,  t»  provide  a  tldhter 
distribution  of  xi  around  its  mean  xi. 


To  formulate  and  solve  the  combined  monitoring  and  patching  decision 
problem,  we  shall  assume  that  Cj  is  the  cost  if  is  true.  Recall  ttet  H  has 
a  (subjective)  probability  P^of  being  true.  Just  as  %,  pi,  q  were  defined  in 
relation  to  the  set  x^,  let  0^,  Pi,  Cj  be  defined  in  relation  to  the  set  xj,  the 
complement  of  x^.  We  shall  use  minimum  expected  cost  EC(d«)  as  the  criterion 
for  selecting  the  best  monitoring  and  patching  decision  d*. 


Let  dii  denote  a  decision  to  monitor  RPV-i  and  patch  RPV-J  in  the  combined 
monitoring  ind  patching  decision  problem.  Since  a  patch  can  be  done  only  on  a 
monitored  RPV,  there  are  only  2N+1  available  decisions.  They  are: 


(i)  Do  nothing  decision  dgo*  that  is,  monitor  no  RPV  and  patch  no  RPV.* 

(ii)  N  pure  monitoring  (no  patching)  decisions  djoi  j=1,2,..,N. 

(iii)  P  patching  (and  monitoring)  decisions  djj,  j=1,2,...,N. 

Let  Puk  denote  the  probability  that  the  hypothesis  is  true  when  the 
decision  is  dii,.  Because  the  RPV  subsystems  are  non-interactive,  it  follows 
that  the  probabilities  associated  with  RPV-i  when  some  other  RPV  is  monitored 
and/or  patched  is  same  as  that  associated  with  RPV-i  when  no  RPV  is  monitored. 
That  is. 


PiOo  =  Pijk  lt=j  or  0 

Thus,  there  are  only  3N  distinct  probabilities  to  be  computed 

(i)  N  probabilities  Pioo  associated  with  do-nothing  decision  dgo 

(ii)  N  probabilities  Pno  associated  with  pure  monitoring  decision  djo 

(iii) W  probabilities  Pjii  associated  with  patching  decision  dji 


Let  (PP)i  denote  the  probability  that  the  patch  decision  dji  "takes",  that  is, 
results  in  x^  xf,  and  let  T^j  denote  the  cost  of  implementing  decision  dij. 
The  costs  Tj  •(  will  be  chosen  to  be  functions  of  mission  time  to  reflect  the 
importance  of  ETA.  As  mission  time  gets  closer  to  ETA  for  RPV-i,  T^j  will  be 
made  larger  and/or  x^  will  be  shrunk  to  reflect  "urgency". 


•  This  could  correspond  to  performing  some  other  task  such  as  communication. 
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The  combined  monitoring  and  patching  decision  problem  is  described  in  terms 
of  a  decision-tree  diagram  in  Figure  5.*  The  actual  cost  of  a  particular 
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Figure  6.  Decision  Tree  Diagram  for  Combined  Monitoring  and  Patching 

decision  depends  on  the  path  chosen  to  traverse  the  tree  from  level  1  to  level 
5.  The  exact  path  from  level  1  to  level  5  for  the  N-RPVs  are  determined  both  by 
the  decision  maker  (the  human  operator)  and  by  Nature  (the  random  elements  in 
the  problem)  .  Since  a  decision  has  to  be  made  at  level  1  before  Nature  has 


~ For  reasons  similar  to  the  one  we  stated  for  combining  the  monitoring  and 
patching  decision  problem,  one  might  argue  that  the  decision  problem  over  the 
rest  of  the  mission  duration  must  be  considered  by  the  operator  at  any  decision 
instant  during  the  mission.  We  shall  not  do  this  because:  first,  the  analysis 
for  this  case  is  no  different  from  the  one  we  present  here  -  only  the 
expressions  are  messier {  and  second,  the  actual  computations  of  the  decisions 
would  become  infeasible  . 


659 


/ 


taken  its  course  at  the  monitoring  level  3  and  at  the  patching  level  4  ,  the 
decision  maker  can  only  evaluate  his  2N+1  alternative  decisions  in  terms  of 
their  expected  costs.  This  he  can  do  as  follows:  The  expected  cost  of  the 
do-nothing  decision  dgo  is 

EC(doQ)  =1^  (Ci  Pioo  ^i  ^iOO^ 

Expected  cost  of  pure  monitoring  decision  djo  ia 

EC(djo)  =  EC(doo)-(CjPjoo+^5jPjOO)+  CjPjjo+CjPjjo)+  Tjq 

Expected  cost  of  a  patching  decision  djj  is, 

EC(djo)  =  E'>.{doo)-(CjPjoo-^^jPjOO)+(CjPjjj+CjPjjj)-(PP  P  Tjj) 

The  optimal  decisiwi  d*  is  the  one  which  results  in  maximum  opportunity  gain, 
that  is,* 

d*  =  arg  min  (  ECCdgo,  EC(dgio)i  ECCdi^jj)  ) 

where 

m  =  arg  maxj  ((CjPjoo-^^jf  j00^~  ^jO  ^ 

k  =  arg  mcxj  ^ 

Consider  a  specialization  of  the  above  decision  problem  where  the 
probabilities  Piiic  ai*®  assumed  to  be _ independent  of  the  aecisions  d^ij-Cthat  is, 
Pi  1k  *  ^0  >  costs  Cj  and  T^j  are  all  zero,  and  the  patch  sui  ess 

probabilities  (PP)i=1  for  each  subsystem  RPV.  Then  the  optimal  decision  is 

d*  =  djj 

where 

j  =  arg  maxi  (Pj  Cj) 

This  is  the  result  obtained  by  CarbonelK reference  12). 

An  implicit  assumption  made  in  the  computation  of  expected  cost  in  the 
combined  monitoring  and  patching  decision  problem  is  that  the  costs  are  constant 
over  the  entire  sets  iiJx  and  x^.  This  assumption  is  easily  dropped  when 
non-constant  cost  functions  are  desired,  e.g., 

C(ei)  s  ei’  M  e^ 

In  such  a  case,  PijkCi  in  the  above  analysis  will  be  replaced  by  an  appropriate 
integral  which  would  yield  PijkCi  as  a  function  of  and  and  appears 
amenable  for  computations. 


»  The  notation  arg.  min.  implies  d*sdoo  or  djno  or  dj^jc  depending  on  which  of  the 
three  values  EC(doo)»  EC(dnjo),  EC(dkk)  is  the  smallest.  Here  dmo  is  the  best 
monitoring  decision  and  dkk  is  the  best  patching  decision. 
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We  close  this  appendix,  with  an  example  of  a  piecewise-constant  cost 
function  that  appears  meaningful  for  the  N-RPV  system  under  study.  Recall  from 
appendix  A  that  the  first  two  components  of  x  are: 


=  ground  speed  error  (along  track) 
s  cross-track  error 

One  choice  for  the  piecewise-constant  cost  function  is 

C(ei)  =  1  if  !xj!  >  x^T  =250 

=  0  if  IxJ!  i  250 
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in  predicting  the  performance  gains  to  be  expected  frco  the  introduction  of 
such  aids..  Further,  in  systems  in  which  the  re.*5ponsibilities  for  some  tasks 
are  shared  by  the  operator  and  an  automated  deoisicn  maker,  these  models 
might  also  be  used  within  the  system  to  coordinate  the  actions  of  the  two 
decision  makers. 

Senders  [1]  and  Smallwood  [2]  have  modeled  human  decision  making  in 
multiple  process  monitoring  tasks.  Senders  postulated  that  the  human  monitor 
samples  his  displays  in  a  manner  which  allows  reconstruction  of  the  displayed 
signals.  An  information  theory  approach  is  employed  to  determine  how  often 
and  for  what  duration  the  human  must  sample  each  display.  Smallwood  proposed 
that  the  human  operator  forms  an  internal  model  of  the  processes 
monitoring  and  of  the  environment  relevant  to  his  task  as  a  result  of  his 
past  perceptions  of  them.  A  situation  is  considered  in  which  the  operator 
seeks  to  detect  excursions  of  instruments  beyond  threshold  values.  The 
operator  is'  modeled  as  directing  his  attention  to  the  instrument  whose 
current  probability  of  exceeding  threshold  (based  on  the  operator’s  internal 
model)  is  greatest.  It  might  be  noted,  in  passing,  that  the  internal  model 
concept  discussed  by  Smallwood  is  perhaps  as  appropriate  to  the  design  of 
automated  decision  makers  as  it  is  to  modeling  the  human  decision  maker.  If 
the  automated  decision  maker  is  to  interact  appropriately  with  the  human,  it 
would  seem  that  its  internal  model  of  the  relevant  environment  should  include 
a  model  of  the  human. 


Carbonell  [3,4]  and  Senders  and  Posner  [5]  have  proposed  queueing  theory 
approaches  to  the  modeling  of  human  decision  making  in  multiple  process 
monitoring  tasks.  Carbonell  uses  a  priority  queueing  discipline.  He  assumes 
that  the  human  operator  attempts  to  minimize  the  risk  involved  in  not 
observing  other  instruments  when  he  chooses  to  monitor  a  particular 
instrument.  Senders  and  Posner  employ  a  first  come  first  served  service 
discipline.  They  suggest  two  models  which  might  be  used  to  estimate  the 
inter-observation  intervals  for  an  instrument  (i.e.,  the  time  between 
arrivals  of  the  instrument  to  the  queue  of  instruments  awaiting  observation 
by  the  human  monitor).  The  first  model  involves  the  degree  of  the  observer's 
uncertainty  about  the  value  of  the  variable  displayed  on  the  instrument.  The 
second  model  involves  the  probability  that  the  displayed  variable  will  exceed 
an  acceptable  limit. 


The  models  cited  above  emphasize  the  monitoring  of  displays,  rather  than 
the  decisions  or  actions  that  result  from  the  human  ooerator's  perception  of 
the  displayed  values.  The  operator's  motivation  for  monitoring  the  displays 
is  the  possibility  that  an  event  which  requires  his  action  will  occur.  The 
multi-task  decision  making  problem  addressed  in  this  paper  concerns  the  event 
detection  and  action  selection  decisions  the  operator  makes  on  the  basis  of 
the  information  he  gains  throu^  monitoring. 


Human  decision  tiaking  in  such  multi-task  situations,  then,  might  be 
modeled  in  terms  of  the  manner  in  which  the  human  detects  events  related  to 
his  tasks  and  the  manner  in  which  he  allocates  his  attention  among  his  tasks 
once  he  feels  events  have  occurred.  Gai  and  Curry  [6]  have  developed  a  model 
of  the  human  monitor  in  a  failure  detection  task.  The  model  has  two  stages, 
♦he  ^’’rst  ♦-‘ing  a  Kalman  filter  which  estimates  the  states  and  observations 
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of  the  monitored  process  and  the  second  a  decisicn  mechanism  which  operates 
on  the  Kalnan  filter  residuals  using  sequential  analysis  concepts.  The  model 
can  be  used  to  describe  the  human  monitor's  detection  of  additive  failures  in 
stationary  random  processes. 


Sheridan  and  Tulga  [7]  have  modeled  the  manner  in  which  the  human 
operator  allocates  his  attention  among  various  tasks.  They  address  a 
situation  in  which  events  present  themselves  unequivocally  and  use  a  dynamic 
fro^SmSng  approach  to  aetermine  the  action  sequence  which  maximises  the 
operator's  eaminds.  This  action  sequence  is  begun,  but  can  be  superceded  by 
a  mw  sequence  calculated  in  response  to  the  appearance  of  additional  tasks. 


Rouse  [8]  has  investigated  the  issue  of  allocation  of  decisiai  making 
responsibility  between  a  human  operator  and  an  automated  decisicn  maker.  He 
presents  a  mathematical  formulaticxi  of  the  multi-task  decision  making 
situation  approoriate  to  the  modeling  of  either  decision  maker.  Eased  on 
displayed  information,  the  decision  maker  is  assumed  to  generate 
probabilities  that  events  have  occurred  in  his  tasks.  He  also  generates 
density  functions  which  characterize  his  perceptions  of  what  might  occur  in 
his  tasks  while  his  attention  is  diverted  to  a  particular  task  and  how  long 
his  attention  will  be  diverted  should  he  decide  to  take  a  given  action. 
Combining  estimates  of  the  probabilities  events  have  occurred  with  the 
density  functions  of  time  between  events  in  the  tasks  and  action  times  with 
respect  to  the  tasks,  the  decision  maker  chooses  his  actions  to  minimize  an 
appropriate  cost  criterion.  In  this  paper,  we  present  a  model  of  the  human's 
event  detection  performance  consistent  with  this  mathematical  formulation, 
describe  an  experimental  study  of  event  detection  performance  in  a  multiple 
process  monitoring  situation,  and  address  the  application  of  the  model  to  the 
process  monitoring  situation. 


THE  EVENT  DETECTION  MODEL 


The  event  detection  model  assumes  that,  in  attempting  to  detect  events, 
the  human  generates  the  probabilities  that  events  have  occurred.  A 
disorimirant  analysis  approach  [9,10]  is  used  to  model  the  human-s  generation 
of  these  probabilities.  Our  use  of  discriminant  analysis  to  model  the 
human's  generation  of  event  probabilities  is  motivated  by  the  fact  that  this 
approach  does  not  .'ecuire  explicit  models  of  the  systems  the  human  is 
nonitoring.  An  understanding  of  the  systems  is  certainly  helpful  in 
determining  the  features  to  extract  from  the  observations.  But  explicit 
models  of  the  systems’  structures  are  not  required. 

vor  each  task  i,  various  features  x^^^,  j=1,2,  ...,m£,  are  extracted  from 
the  human's  task  related  observations  These  features  are  properties  of 

the  observations  that  characterize  (or  are  believed  to  characterize)  the 
presence  or  absence  of  events  related  to  the  task.  Following  the  extraction 
of  a  -set  of  featiirpsi,  the  value  of  a  linear  discriminant  funutioii 


665 


(1) 


is  calculated.  Based 

made  of  the  discriminant  obtain  the^^discriminant  function  score 

to  combine  the  feature  valu  of  events  from  the  rest  of  the  task 

I,  that  heat  dirferantlatea  ^  llT^JiToe  of  Uia  dlaorLinant 

rllatadohaervatlooa.  .“'‘“““J/  of  th.  ohservatloia 

function  over  ^  that  an  event  has  occurred  is 

a„  also  fomad.  The  »  P® ^Sl^nt  “»“®  ““'P' 

S  “ 


P(ei/Yi)  ^  Vqj,^  + 
1  -  PCe^Aj^)  V 


(2) 


'H, 


+  C 


'Ma 


,^'u?  «^^‘sL'rha«uV“4"h.-«p  “{“"Hi 
Z7u\ru  r  s'^ooft 

rejection),  Cpft  is  e  responding  "event"  (a  hit),  and  C„  is 

fhno;A^i.-%;urr— ^  "no  event"  (a  miss). 

It  is  predicted,  then^  that  if  toe^  ^^e^t?^he’^°calculate3  the 

decision  on  the  P^Jf”®®  ^fthe  left  hand  side  of  Eq.  (2)).  He  compares 
likelihood  ratio  of  ^  ^  ratio  with  a  threshold  determined  by  the 

the  magnitude  of  the  lik  costs  of  incorrect  responses  (the  right 

srsl*  oTC  u’r  He“Voh'd,“«:oh-  if  th,  Uhelihood  ratio  ,»„ds 
the  threshold. 


THE  EVENT  DETECTION  EXPERIMENT 


An  pJwLs«  occurrence  of  events 

1  illustrates  the  ^  Tektronix  4010  by  a  time-shared  DEC-System 

static  display  was  outputs  of  nine  processes  over  100 

10  and  depicts  the  mea^  points).  The  processes  had  identical  second 

^^S^'”sys^"c^dS®ies  H'ith  a  nahurel  frequency  of  0.7-5  rad/rec  and  a  damping 
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Figure  1  .  The  Multiple  Process  Monitoring  Situation 


ratio  of  0.5.  Samples  were  taken  at  0.2  second  intervals.  The  inputs  to  the 
processes  were  zero-mean  Gaussian  white  noise  sequences  of  identical 
variance.  The  displayed  measurements  were  obtained  by  corrupting  the  process 
outputs  with  additive  zero-mean  Gaussian  white  noise  sequences  which  normally 
had^ identical  variance.  The  laeasurement  noise  variance  was  normally  selected 
to  yield  measurements  with  signal-to-noise  ratios  of  25.0.  An  abnormal  event 
in  a  process  was  defined  by  an  increase  in  the  measurement  noise  variance 
suca  that  the  signal-to-noise  ratio  following  an  event  occurrence  was 
decreased  to  95$  of  the  signal-to-noise  ratio  of  the  preceding  measurement. 
Thus,  abnormal  events  became  more  pronounced  with  each  measurement  following 
their  occurrence. 

After  scanning  the  nine  process  histories,  the  subject  was  given  an 
opportunity  to  key  in  the  numbers  of  processes  in  which  he  had  decided  an 
abncriaal  event  had  occurred.  He  was  then  given  feedback  regarding  the  actual 
states  of  the  processes  he  had  keyed  in  ("V  indicating  the  normal  state,  ■•0" 
in^ating  the  abnormal  state).  An  iteration  in  a  trial  was  completed  by 
erasing  the  display,  scoring  the  subject’s  performance,  and  returning  all 
abnormal  processes  detected  by  the  subject  to  the  normal  state.  Another 
iteration  was  then  begun  by  generating  a  new  display  depicting  the  process 
histories  advanced  10  sampling  intervals  in  time  as  illustrated  by  Figure  2. 
(The  dashed  vertical  lines  indicated  to  the  subject  the  point  at  which  he 
last  responded  to  each  process.) 
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me  subjeot  was  allowed  10  °  “je“°’'ri''e'l”irfiw  blsl'  scores  for 

oowrred.  Be  was  swarded  poeoM  for  ^U_^Bits,J^  lower  scores  for  tardier 

ro-r  n  vs?  f 

“ro1.“,“d*rf?r«  eaoB  Iter.tlto  redwood  toe  score  awarded  for 

Its  made  c»  that  Iteration. 

_ _ _  <?naced  over  several  days.  Each 

Eight  subjects  were  given  three  trx  half  the 

;rial  was  20  iterations  long.  JJ'®  scheduled  to  occur  per  iterative 

subjects  were  identical,  %„ents  as  the  first  and  third  trials. 

Cheir  second  trial  scheduled  the  each  iteration.  The  rest 

3Ut  also  scheduled  an  addi  trials  in  different  order  so  that  two 

3f  the  subjects  were  given  >  dheratlcxi  in  the  first  and  third  trials 

events  were  scheduled  to  scheduled  in  the  second  trial.  (Not 

while  one  occurrence  per  Tf  an  event  was  scheduled  to  occur 

Si  scheduled  events  had  n^^et  been  detected  by  the 

in  a  process  in  which  a  "the  trial.)  Events  were 

subject,  the  over  the  nine  processes  and  over  the  10  new 

scheduled  to  occur  each  iteration  (the  last  10  points  on 

points  displayed  for  ^  points  were  new)  within  the  constraint 

.’“irlewwc  witBlw  30 
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each  other. 


Sefor^'  each  trial,  the  subject  was  told  the  average  ainber  of  new  events 
he  could  exjv.ct  to  occur  per  iteration.  He  was  not  given  anv  information 
regarding  the  dynamics  of  the  processes,  but  was  told  that  he  could  expect 
the  processeii  to  exhibit  similar  characteristics  when  operating  normally.  He 
was  also  not  told  what  parameter  changes  defined  events,  but*was  told  that 
all  events  would  generally  exhibit  similar  characteristics,  and  all  would 
become  more  pronounced  as  time  passed.  The  subject  was  given  several 
iterations  of  training  before  each  trial  during  which  solid  vertical  lines 
were  included  on  the  process  histories  to  mark  exactly  when  and  where  events 
had  occurred. 

During  each  trial,  the  subject  was  asked  to  keep  a  log  in  which  he 
described  his  strategies  for  event  detection  and  noted  characteristics  of  the 
process  measurements  he  used  in  his  attempts  to  detect  events.  After  each 
trial,  he  was  asked  to  order  these  characteristics  in  terms  of  their 
usefulness  in  event  detection. 


APPLICATION  OF  THE  MODEL  TO  THE  EXPERIMENTAL  SITUATION 


The  event  detection  model  suggests  that  the  human  operator  in  the 
experimental  situation  just  described  extracts  various  features  from  his 
observations  of  the  process  measurements.  He  attempts  to  select  features 
which  characterize  the  presence  or  absence  of  task  related  events.  Through 
his  experience  with  the  processes,  the  operator  has  formed  estimates  of  the 
discriminant  function  coefficients  with  which  to  combine  the  features  to 
obtain  a  discriminant  function  score.  He  nas  also  formed  estimates  of  the 
means  and  variances  of  this  score  over  observations  of  events  and  over  the 
rest  of  his  observations.  The  operator  gener-ates  the  likelihood  ratio  that 
an  event  has  occurred  based  on  the  value  of  the  discriminant  function  score, 
his  estimates  of  the  means  and  variances  of  the  score,  and  his  estimate  of 
the  a  prtori  probability  of  an  event  occurrence.  He  compares  the  likelihood 
ratio  with  a  threshold  that  is  based  solely  on  the  values  of  correct 
responses  and  the  costs  of  incorrect  responses  and  responds  "event**  if  the 
likelihood  ratio  exceeds  the  threshold. 


Four  features  of  the  process  measurements  were  selected  for  use  with  the 
event  detection  model.  Selection  of  these  features  was  guided  by  the 
comments  of  the  experimental  subjects  regarding  the  characteristics  of  the 
process  measurements  they  found  useful  in  event  detection.  The  first  feature 
involves  the  magnitude  changes  between  successive  measurements  in  a  secuence 
of  the  most  recent  measurements.  The  second  feature  involves  the  presence  of 
reversals  in  direction  in  this  sequence  (changes  from  positive  slope  to 
negative,  or  vice  versa,  of  the  line  segments  connecting  the  measurements  of 
the  sequence).  The  third  feature  tests  for  the  simultaneous  occurence  of 
large  magnitude  changes  and  reversals.  The  fourth  feature,  like  the  first 
is  a  measure  of  magnitude  ohs.ngos ,  bu  t  it  is  mucn  more  local  in  that  it 
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involves  only  the  four  most  recent  measurements  of  the  process  output. 

of  thfflaluret^nLl^®®®  features  from  the  process  measurements,  the  value«^ 

^'lu«  thanks; 

the  age  of  the  measurement  and  the  rate  of  this  decrea*^*^ 

The  value  of  the  first  featurr  V  ,  decrease  is  a  free  parameter. 

Changes  between  successive  measiremente  Tn  a’seque”ncTo?  toe 
measurements  of  a  process-  output,  is  given  by  ^ 


n- ! 

*1  =  <  Z  I2(‘^*1)-z(‘c)l-exp[-^(n-1-k)]}/gexp[-/9(n.1-k)]  (3) 

k  =  i 

vhere  z(k)  is  the  k  to  mea.siircment  in  the  seouence,  zCn)  is  too  *. 

o„r  which  the  ■fea\rcf  .rro^LwUtcc  “Sd"“^th°^h^^ 
measurement  displayed  for  the  nroeess  on  frh=n-  vc  “ 

used  in  extracting  the  features  from  thro^S^et^^Vj  r” ' 

of  the  features  over  process  measurements  taken  earlie?  toaTtoe^^t 

not  calculated  (or.  effectiv^iv  =»-»  ==-<—  ^  earner  than  the  cutoff  are 

responded  -event-  to  the  pS^ Tt  some  n^nw 

features  are  calculated  over  onlv  t-hn^o  ^  followinfit  the  cutoff,  then 

rccpchce.  The  iSilJatL  cutHf 

when  he  reepends  to  the  praiess  iBtlvstec  th“s  conctralM 

in  the  normal  state,  then  on  succeedir^  itonafT^f  I!  process  is 

ah  event  h.a  ocemred.  It  .St^^eloSrJeTStSw,  ““  ”■ 

the  proceaa  la  In  the  etnonna”  atafe  wi  ■  '^tponee.  If 

When  toe  subject  keys  in  nis  resBonno  ’  rin  ”  Process  is  reset  to  normal 
knows  that  if  another  ^ven^  hT  occur  red' Tn  to/ 

occurred  following  his  last  resnon«!<»  Tn  4*1,  process,  it  must  have 

model)  should  calculate  feature-  onlv  over  subject  (and  the 

subject’s  last  response.  ^  °  measurements  occurring  after  the 

repreL'n^taul'^of"  n°oLal''"a/f  TbLr^a/^^oc  ® 

representation  was  formed  using  the  oriSesa  h  i 

subject  on  his  third  exnerimentai  toiai  the 

into  two  groups  of  secuences  -  ®  histories  are  separated 

measurements  beginning  when  a  proe’ess  was  retu^ed  t^tbl’ 

ending  when  an  event  occurred  are  defined  to  *  ho  ^  i  normal  state  and 

«aa„ra.c„ta  bcslnnlns  when  an  ..cm  oS“d  and  aMl-TwZ'  o'- 

returned  to  the  normal  state  are  definprf  i-«  k  “'’®"  the  process  was 

fear  featnraa  wa,,  oalnuiud  o~  r  ^  ^ 

in  the  two  ,roupa.  A  hlaorl.lnart  aSyala  ^i  ttl"'’.'’.”’'/''’”"'" 

cTffic\?fnr.n^r/rrwifhThi‘:hi'«“““- 
dlffa.a„«.lc  AVwian\Ac-;;:-^“  :“t^c 
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resulting  discrimirant  function  scores  for  the  sequences  in  each  of  the  two 
groups  was  also  calculated. 

The  final  requirements  for  application  of  the  event  detection  model  to 
the  experimental  situation  are  estimates  of  the  a  priori  probabilities  of 
event  occurrences  and  the  selection  of  a  threshold  against  which  likelihood 
ratios  of  events  can  be  compared.  For  experimental  trials  in  which  one  event 
was  scheduled  to  occur  per  update  of  the  display  over  the  nina  processes 
monitored  by  the  subject  the  a  priori  probability  of  an  event  occurrence  in 
each  process  was  fixed  at  1/9-  For  trials  in  which  two  events  were  scheduled 
to  occur  per  display  update,  the  a  priori  probability  was  fixed  at  2/9-  The 
threshold  against  which  the  likelihood  ratios  of  events  are  compared  is 
assumed  to  remain  constant  through  an  experimental  trial.  The  magnitude  of 
this  constant  is  a  free  parameter. 


RESULTS 


Figure  3  compares  the  event  detection  performance  of  the  model  with  the 
actual  performance  of  each  of  the  eight  subjects  in  the  third  trial  of  the 
experiment.  In  this  trial,  20  events  were  scheduled  to  occur  in  the  trials 
given  subjects  A.E,C.  and  D,  while  UO  events  were  scheduled  to  occur  in  the 
trials  given  subjects  E,F.G,  and  R.  In  applying  the  model  to  each  of  these 
trials,  the  number  of  measurements  over  which  features  were  extracted  (cutoff 
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lenath)  and  the  relative  weighting  of  recent  and  older  points  ( fi)  were 
adjusted  to  improve  the  fit  of  the  model’s  performance  to  each  subject  s 
peJformance.  The  value  of  the  threshold  against  which  likelihood  ratios  of 
events  were  cr jpared  was  also  adjusted  to  improve  the  fit .  Figure  3 
a  high  degree  of  correspondence  between  the  model’s  performance  and  the 
performance  of  most  subjects. 


Figure  4  compares  the  event  detection  performance  of  the  model  wit*  the 
actual  performance  of  the  eight  subjects  in  the  second 
experiment.  In  this  trial,  40  events  were  scheduled  vO  occur  in  the  fc»'ials 
given  subjects  A.B.C,  and  D,  while  20  events  were  scheouled  to  oc«ur  in  the 
S^ials  given  subjects  E,F,G,  and  M.  In  applying  tho  model  to  each  '’f 
trials,  none  of  the  parameters  of  the  model  were  changed  from  the  setting 
used  to  obtain  the  results  presented  in  Figure  3-  Despite  the  fact  that  the 
numbers  of  events  scheduled  in  these  trials  differ  from  those  in  the  .rials 
used  to  assign  the  values  of  the  parameters,  the  correspondence  between  the 
model's  performance  and  the  performance  of  most  subjects  is  reasonable. 


Table  1  compares  the  mean  detection  times  (in  terms  of  the  number  of 
sampling  intervals  which  elapsed  from  the  occurrence  of  an  event  to  the  time 
of  its  detection)  for  hits  common  to  both  subject  and  model  in  the  trials 
presented  in  Figures  3  and  4.  It  should  be  noted  that  the  fact  that  the  mean 
detection  times  of  the  model  are  consistently  smaller  than  those  of  the 
subjects  is  an  artifact  of  the  manner  in  which  the  model’s  performance  was 
investigated.  The  model  was  tested  on  the  process  histories  displajod  to  a 
subject  in  his  experimental  trial.  In  these  trials.  .  process  was  returned 
lo  the  noiiual  state  at  the  point  at  which  the  suhjec.  detected  an  event  i.. 
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the  process.  Thus,  in  going  over  the  process  histories  the  model  can 
respond  to  an  event  later  than  the  subject  responded  to  it.  If  the 
fails  to  responn  to  an  event  by  the  time  of  the  subject's  response,  the 
is  scored  as  liaving  missed  that  event. 


never 

model 

model 


Table  1 ,  -  Comparison  of  Mean  Detection  Times 


Trial 

1 

Trial 

2 

Subject 

Subject 

Model 

Sub  ject 

Model 

Code 

A 

24 

19 

24 

20 

E 

26 

21 

25 

19 

C 

28 

17 

28 

17 

D 

32 

21 

30 

16 

E 

18 

13 

22 

17 

f 

17 

1M 

27 

16 

G 

20 

17 

27 

20 

h 

20 

17 

22 

18 

We  plan  to  evaluate  the  model  in  the  near  future  using  a  somewhat 
different  approach.  Rather  than  running  the  oiodel  over  the  process  histories 
displayed  to  a  subject  on  an  earlier  experimental  trial  (and  constraining  the 
timing  of  the  model's  responses  by  the  timing  of  the  subject's  responses  in 
that  trial),  we  will  use  the  model  in  place  of  the  subject  in  the  event 
detection  experiment.  Processes  in  which  events  occur  will  then  remain  in 
the  abnormal  state  until  the  model  responds  to  the  process  The  only 
constraint  on  the  model’s  detection  times  will  be  the  end  of  the  experimental 
trial.  Because  the  model's  detection  time  for  each  event  need  no  longer  be 
less  than  or  equal  to  the  subject’s  detection  time  for  that  event,  v:e  expect 
that,  for  a  given  number  of  hits,  the  model's  threshold  can  be  raised  to 
achieve  the  longer  mean  detection  times  and  smaller  numbers  of  false  alarms 
characteristic  of  the  subjects  in  the  experiment. 


CONCLUDING  REMARKS 


In  applying  the  event  detection  model  to  the  experimental  situation 
described  in  this  paper,  we  studied  a  situation  in  which  the  subject  was 
forced  to  respond  yes  or  no  to  the  possibility  of  an  event  related  to  each  of 
nine  processes.  In  general,  the  human  operator  is  not  forced  to  make  such 
yes/no  decisions  with  respect  to  each  of  his  tasks.  Instead  he  uses  his 
estimates  of  the  probabilities  of  task-related  events  (which  the  event 
detection  model  generates)  in  deciding  how  to  allocate  his  attention  among 
his  tasks.  We  plan  to  run  an  experiment  investigating  the  human *s  attention 
allocation  performance  in  a  multiple  process  monitoring  situation  similar  to 
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the  one  employed  in  the  event  detection  experiment  discussed  here.  Data  from 
this  experiment  will  be  used  to  develop  and  validate  a  o»del  of  attenti^ 

multi-task  situations.  (The  modeling  of  humn 
r?n  ?  Pe^-formance  in  multi-task  situations  is  considered  in 

i”a' DaJ*t“crt?i  “***  in  conjunction  with  the  event  detection  model 

^  ^  process  for.  and  the  implementaticn  of.  automated 

aecision  making  systems. 
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SUMMARY 

An  experimental  representation  of  a  computer-aided  multi-task  flight 
management  situation  has  been  developed.  A  computer  aiding  program  was 
implemented  to  serve  as  a  back-up  decision  maker.  An  experiment  was 
conducted  with  a  balanced  design  of  several  subject  runs  for  different 
workload  levels.  This  was  achieved  using  three  levels  of  subsystem  event 
arrival  rates,  three  levels  of  control  task  involvement,  and  three  leve’s  of 
availability  of  computer  aiding.  Experimental  results  compared  quite 
favorably  with  those  from  a  computer  simulation  which  employed  a 
(M/Ej^/2):(PRP/K/K)  queueing  model.  It  was  shown  that  the  aiding  had  enhanced 
system  performance  as  well  as  subjective  ratings,  and  that  the  adaptive 
aiding  policy  further  reduced  subsystem  delay. 

INTRODUCTION 

As  aircraft  become  more  complicated  and  greater  demands  and  better 
performance  are  being  required  of  pilot,  the  development  of  automated 
airborne  systems  to  share  the  tasks  of  piloting  an  airplane  becomes 
increasing  attractive.  Advances  in  electronics  and  computer  technology  have 
made  ^is  approach  both  feasible  and  promising.  Progress  in  sophisticated 
cockpit  design  and  growth  in  avionic  computer  systems  reflect  the  trend. 

Equiped  with  autopilot  and  airborne  computers  performing  automatic 
navigation,  guidance,  energy  calculations,  flight  planning,  information 
management,  etc.,  the  next-generation  of  aircraft  are  quite  likely  to  be 
capable  of  carrying  out  all  phase  of  flight  automatically.  However,  the 
human  pilot  is  likely  to  reamin  a  part  of  the  system  to  cope  with  unpredicted 
or  failure  situations  for  which  automation  may  be  economically  or  politically 
infeasible.  The  pilot’s  roll  then  is  changing  from  one  of  controller  to  one 
of  supervisor  and  manager,  responsible  for  monitoring,  planning  and  decision 
making. 

•  This  research  was  supported  by  the  National  Aeronautics  and  Space 
Administration  under  K .SA-Ames  Grant  NSG-2119. 
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The  pilot  as  the  airborne  system  manager  has  responsibility  to  monitor 
the  aircraft  subsystems  such  as  navigation,  guidance,  etc.  as  well  as  the 
autopilot  and  to  detect  possible  hardware  failures  and  potential  hazards.  He 
must  constantly  respond  to  action-evoking  events  such  as:  to  communicate 
information,  to  change  aircraft  configuration  and  to  reduce  4-D  accuracy 
errors.  He  is  also  required  to  respond  to  unexpected  events  such  as  a  change 
in  flight  plan,  to  establish  the  backup  mode,  and  to  declare  emergencies, 
etc.  [1].  The  pilot  is  in  a  multi-task  situation. 

If  the  pilot  perceives  an  irregularity  in  one  of  the  subsystems,  he  may 
seek  more  detailed  information  through  either  the  on-board  information  system 
or  actual  sensor  readings.  Or,  if  he  considers  the  irregularity  to  be  minor, 
he  may  decide  to  continue  his  monitoring  for  higher  priority  events.  There 
may  also  be  autopilot  malfunctions  or  sudden  changes  requiring  the  pilot  to 
take  charge  of  flight  control.  A  proper  representation  of  information 
through  a  flight  map  display  indicating  the  continuous  functioning  of 
automatic  control  may  help  to  ensure  his  remaining  alert  and  responding 
quickly.  ® 

As  described  above,  the  automated  system  can  normally  take  charge  of  the 
whole  system  except  during  critical  situations  such  as  when  the  system  is 
suffering  from  a  malfunction.  Or  a  high-workload  situation  may  develop  when 
the  aircraft  is  close  to  the  ground  when  a  high  level  of  pilot  activity  is 
required.  In  all  of  these  situations,  the  pilot  is  more  than  usually  busy 
and  further  assistance  of  a  computer  would  be  most  useful. 

The  recent  development  of  fast  and  Intelligent  computer  systems  presents 
the  potential  for  providing  sound,  well-evaluated  airborne  decisions  which 
could  reduce  system  risk,  pilot  workload  and  errors.  While  the  computer  as  a 
decision  maker  is  basically  an  implemented  set  of  algorithms,  adaptation  and 
learning  is  possible.  It  is  reasonable  to  expect  that  thir  evolving 
"intelligent"  computer  may  be  employed  as  the  supervisor  to  the  subsystem 
computers,  taking  charge  of  the  tasks  within  its  decision  capability.  The 
pilot  and  the  computer  thus  have  comparable  abilities  and  overlapping 
responsibilities  in  performing  these  tasks.  The  problem  that  arises  is  how 
to  allocate  responsibility  between  the  pilot  and  the  computer  for  a  subset  of 
all  tasks. 

We  have  proposed  that  responsibilities  not  be  strictly  assigned  to  each 
decision  maker.  Instead,  allocation  should  adapt  to  the  state  of  the 
aircraft  and  the  state  of  the  pilot  [2].  Further,  to  retain  a  coherent  role, 
the  pilot  should  be  given  overall  responsibility  for  the  whole  aircraft  while 
the  computer  would  enable  the  pilot  to  avoid  having  to  continually  exercise 
all  of  these  responsibilities.  On  one  hand,  it  may  not  be  appropriate  for 
the  computer  to  make  the  vital ,  final  Judgement  where  losses  may  extend 
beyond  the  point  of  recovery.  On  the  other  hand,  there  may  be  vigilance 
problems  and  the  pilot’s  performance  may  degrade.  This  leads  to  the  idea  of 
utilizing  the  computer  as  a  backup  for  the  pilot.  The  allocation  problem 
becomes  one  of  deciding  when  the  computer  should  request  and  relinquish 
responsibility. 
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Queueing  formulation  of  multi-task  decision  making  was  developed  and  will 
discussed  in  the  next  section. 

APPROACH 

tn  a  sItuatiL  that  he  wants  both  to  monitor  the  tasks  often  enough  to  reduce 

Esr:“'e.?;:rr;u"opS 

pilot  .caps  t«e  taaw  “'lerpTfarl.f.tr  1.  a^Hon-avoaln; 

S,p\““  '^fSpo^r  la  aa-“a  «  St  tp.  S  «rata^  aitPar  Py  Pain, 
hird-wired  or  learning  from  the  pilot.  Now  we  may  ““^’^^"^’'the 

S"s>  W  SJSi 

events  represented  by  displayed  4-D  errors  in  manual  control  mode) . 

In  the  queueing  model,  each  server  is  characterized  by  his  observation 

LVrf^rve^ ^aVr^e 

B:L-nSrapi^^a”-ranrainra;7Sin^r“.?rr^^^^^^ 

server  is  busy . 

.  •».,*■  «n«i-  fariterion  in  terms  of  a  stationary  expected  cost 

?haJ  the  human  will  be  better  at  performing  the  task  but  not  have  sufficient 
all  the  tLks  Also  evidence  of  vigilance  and  warm-up  decrements 
^^“*eats\hat  there  is  an  acceptable  workload  range  that  sustains  performance 

suggests  that  there  is^an^accejj^^^  ^  computer  aiding  such 

?hat  a  itnimrlm  waiting  cost  is  achieved  while  maintaining  a  specified 
workload  level. 

^0^.“’  =o7“  ;ror:np“ek^,““.\nS  r,u"of  r- 

accepSS  pilot  workload,  for  computer  on-off  of  the  following  form,  turn 
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the  computer  on  at  arrival  epochs  when  N  2  c.n,  +  c-n-  •►  •••  >  M,  and 
turn  it  off  when  N  <  m,  where  c*,  c,,  •••.  Cjj  are  cost  rates  assessed 
according  to  relative  priorities  and  n.  is  the  number  of  events  waiting  in 
the  subsystem  k.  This  policy  (i.e.,  H  and  m)  should  vary  as  the  system 
variables  vary.  Specific  values  of  M  and  m  have  to  be  determined  for  various 
levels  of  traffic  demand  (i.e.,  event  arrival  rates),  server  performance  and 
task  complexity  (i.e.,  service  rates  and  probabilities  of  errors).  An 
appropriate  approach  to  implement  the  adaptive  policy  is  to  set  up  a  table  of 
stationary  control  policies  beforehand  and  to  employ  a  table  look-up  along 
with  on-borad  estimation  of  system  variables. 

To  obtain  the  optimal  sUtionary  policy,  i.e.,  to  determine  the  values 
of  M  and  m,  a  computer  simulation  was  performed.  Poison  arrivals  and  Erlang 
service  time  distributions  for  subsystem  were  assumed.  The  K  subsystem  tasks 
were  preempted  by  the  control  task  whenever  it  occurred.  The  system  was 
represented  as  a  preemptive  resume  priority  queueing  system: 
(M/Ej^/2):(PRP/K/K)  with  implemented  threshold  control. 

A  simple  case  was  considered  in  which  the  model  parameters  were 
determined  in  the  following  manner.  1)  Subsystem  arrival  rates,  service 
rates,  and  waiting  cost  rates  were  all  uniform  among  the  subsystems.  2)  Two 
levels  of  arrival  rates  were  assumed,  i.e.,  low  arrival  (at  0.0167  events  per 
second)  and  high  arrival  (at  0.0333  events  per  second).  3)  Pilot  performance 
in  terms  of  service  rates,  service  errors  and  control  services  were  obtained 
from  the  experiment  discussed  in  the  next  section.  11)  The  computer  aiding 
employed  the  same  service  rates  as  the  pilot  and  automatically  went  off  when 
no  event  needed  service  (i.e.,  m=0).  The  results  based  on  the  computer 
simulation  of  10,000  events  for  K=6  and  server  occupancy  for  pilot  of  =0.7 
showed  that,  without  control  task,  M=7  for  low  arrival  and  3  for  high 
arrival;  with  control  task,  M=3  for  low  and  1  for  high  arrival.  If  workload 
is  the  primary  consideration,  these  are  threshold  values  which  the  computer 
should  employ  to  adapt  to  both  the  subsystem  arrival  rate  and  the  control 
task  involvement. 

Prediction  of  system  performance  by  the  model  was  also  obtained  through 
the  computer  simulation.  The  results  will  be  discussed  in  the  later  section. 

THE  EXPERIMENT 

Two  experiments  are  to  be  discussed  here.  A  brief  review  is  given  of  an 
experiment  previously  reported  by  Walden  and  Rouse  [5]  investigating  pilot 
decision  making  in  an  unaided  situation.  The  second  experiment,  considering 
the  computer  aiding  and  autopilot  malfunction  situations,  employs  basically 
an  outgrowth  of  the  experimental  representation  used  in  the  previous 
experiment . 

The  experimental  situation  developed  earlier  [6]  used  a  PDP-11  driven 
CRT  graphic  system  to  represent  a  cockpit-like  display  to  an  experimental 
subject.  The  display  shown  in  Figure  1  included  standard  aircraft 
instrunents  such  as  artificial  horizon,  altimeter,  heading  and  airspeed 
indicators.  Also  displayed  was  a  flight  map  which  indicated  the  airplane’s 
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position  relative  to  the  course 
the  mapped  course  indicating  the 
be  on  shcedui.e. 


to  be  followed.  A  small  circle 
position  the  aircraft  should  hav* 


oved  along 
for  it  to 


Figure  1.  frie  Flight  Myarigf;;rncriu  SitUicioa. 

^  control  mode,  the  pilot  controlled  the  pitch  -nd  roll  of 

Boeing  707  aircraft  dynamics  with  a  joystick.  Another 

^  ■sintalolo*  ,  ,uitu0,  J, 

o^o  a?roo» ‘rs  ooeinrs":^,^^^" 

reppoM,  thp  pppject  pelpotpd  that  suLypu.  vipThx]  kSbSjf  ° 

Ph«™  1„  Figure  2  then  pppepred.  Thip  Lprepepted  TSS 

list-like  tree  associated  with  the  subsystem  of  interest  H<»  thon  <>  u  ^ 
for  a  branch  labeled  with  a  zero  and  seleted  the  JrancS'wiS  S^  kSboLd 

inter-arrival  time  of  subsystem  events  and  the  difficulty  of  t?e*'flight%S! 
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The  results  showed  that,  while  average  waiting  time  increased  with  subsystem 
event  arrival  rate,  the  average  service  time  appeared  to  be  independent  of 
subsystem  arrival  rate.  The  waiting  time  was  also  shown  to  increase  as  the 
control  task  was  added.  This  effect  was  only  a  function  of  the  mere  presence 
of  the  control  task,  rather  than  the  control  task  difficulty.  Incorrect 
actions  in  servicing  subsystems  tended  to  increase  with  subsystem  arrival 
rate,  but  showed  no  consistent  variation  with  control  task  difficulty.  False 
alarms,  however,  tended  to  occur  more  frequently  with  the  easier  control  task 
and  lower  subsystem  arrival  rate.  This  presented  evidence  of  performance 
degradation  under  low  ;ioriclo-id  attuatio.ns. 


BRANCH  EN6  1  ENG  2  ENG  3  ENG  4 
state  10X1 


Figure  2.  Display  When  Pilot  Had  Reacted  To  an  Event  in  Engine  Subsystem. 

The  data  collected  was  used  in  the  queueing  model  of  pilot  decision 
making  in  an  unaided  monitoring  and  control  situation.  The  model  gave  a 
reasonable  prediction  of  pilot  performance  in  performing  subsystem  tasks, 
suggesting  that  it  was  an  adequate  description  of  pilot  decision  making  in 
the  given  situation  and  that  a  similar  model  would  be  useful  in  the  adaptive 
aiding  system. 

Based  on  the  experimental  representation  discussed  above,  a  new 
experimental  situation  for  adaptive  aiding  was  developed  with  the  aiding 
program  (i.e.,  the  computer  decision  maker)  and  the  coordinator  program 
(i.e.,  the  on-off  algorithm)  added  to  the  original  system.  Issues  concerning 
the  capability  of  the  computer  to  perform  the  subsystem  tasks,  the 
communication  linkage  between  the  pilot  and  the  computer,  and  the  activities 
of  the  coordinator  deserve  further  discussion. 
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The  computer  is  assumed  to  be  able  to  perform  monitoring  and  diagnostic 
check  procedures  using  information  from  channels  linked  with  subsystem 
computers  and  from  the  data  links.  It  makes  no  errors  such  as  false  alarms, 
missed  events,  or  incorrect  actions  after  it  gains  confidence  in  performing 
the  task.  The  detection  and  service  times  are  assumed  constant.  As  for  the 
service  discipline  among  the  subsystems,  the  computer  employs  the  same 
priority  rule  as  that  used  by  the  pilot.  To  be  consistent  in  its  back-up 
role,  the  computer  probably  adapts  itself  to  the  pilot  and  avoids 
interference  with  him.  To  this  end,  the  pilot  is  allowed  to  override  any 
decision  the  computer  has  made. 

Without  knowing  what  each  other  is  doing,  the  pilot  and  the  computer  may 
compete  for  the  same  task  or  resource.  The  prospect  of  conflict  between  the 
two  is  highly  undesirable,  since,  it  simply  causes  confusion,  results  in 
higher  workload  and  degraded  performance.  The  question  as  to  how  to  design 
effective  communication  links  without  increasing  the  pilot’s  workload  becomes 
important . 

To  inform  the  pilot  of  the  computer’s  action,  a  succinctly  displayed 
computer  status  indicator  on  or  near  the  subsystem  displays  would  seem  to  be 
satisfactory.  Relevant  information,  if  needed  by  the  pilot  for  further 
details,  may  be  structured  into  a  hierarchical  check-list  procedure.  In  the 
experimental  situation  shown  in  Figure  3f  The  ’MAV’  symbol  over  .  the 
navigation  dial  flashed,  if  the  computer  decided  that  an  event  had  occurred 
and  was  waiting  to  be  serviced  in  the  navigation  system.  This  was  to  tell 
the  pilot  that  he  could  take  charge  of  the  navigation  system  and  the  computer 
would  take  some  other  responsibility  to  avoid  interference;  otherwise,  the 
symbol  would  continue  to  flash  for  a  total  period  of  four  seconds  until  the 
computer  started  interacting  with  the  navigation  system,  resulting  in  a  dim 
indicator  showing  in  the  navigation  dial.  If  the  pilot  was  in  the  middle  of 
performing  some  other  subsystem  check  procedure,  say,  within  the  engine 
system,  he  would  not  see  the  flashing  ’NAV’  symbol  over  the  navigation  dial. 
The  status  of  the  computer  was  then  shown  on  the  lower  right  hand  corner  of 
the  CRT  by  an  ’AIDING  NAV’  symbol  (flashing  during  the  interval  of  possible 
pilot  preemption),  if  the  computer  was  awaiting  preemption  or  interacting 
with  the  navigation  subsystem.  This  computer  status  area  was  blank  if  the 
computer  was  not  actively  involved  in  the  subsystems. 

Airborne  pilot-to-computer  communication  is,  in  general,  more 
complicated.  Problems  involved  include  estimating  and  processing  signals  as 
well  as  matching  or  recognizing  system  status.  For  the  purpose  of  the 
experiment  reported  here,  however,  the  communication  channel  from  the  pilot 
to  sybsystems  was  predefined.  For  our  experimental  situation,  these  included 
the  keyboard  input  and  stick  response  sampling  (through  an  A/D  converter). 
These  channels  provided  the  monitoring  computer  a  way  of  determining  if  the 
pilot  was  interacting  with  any  portion  of  the  system.  If  a  number  had  been 
received  through  keyboard,  and  the  checklist  was  being  processed  then  the 
pilot  had  to  be  performing  a  subsystem  task.  The  deviation  of  stick  from 
normal  position  revealed  that  the  pilot  was  performing  the  control  task. 
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Table  1.  Design  of  Experiment. 


Subject  t 

SuBjaet  2 

'ubjrct  1 

Subject  « 

(traiffiflR) 

(training) 

(training) 

(training) 

totf  srrtval 
with  aidinii 

tou  arrival 
without  aiding 

high  arrival 
with  aiding 

high  arrival 
without  aiding 

without 

MatrttfiCtini 

low  arrival 
without  aidinc 

high  arrival 
with  aidirg 

low  arrival 
with  aiding 

high  arrival 
without  aiding 

hirh  arrival 
without  aiding 

low  arrival 
with  aiding 

high  arrival 
with  aiding 

low  arri  *1 
without  aiding 

high  arrival 
without  aidma 

him  ar»ivaj 
with  aiding 

l.*w  arrival 
without  aicina 

Irw  irriv*! 
with  aiding 

Uraming) 

(training) 

(trainirg) 

(training) 

no  arrival 

no  arrival 

no  arrival 

no  arrival 

low  arrival 
with  aidtrg 

lew  arrival 
without  aiding 

►igh  arrival 
with  aiding 

hiph  arrival 
without  aiding 

Rmiat 

Contrul 

low  arrival 
without  aiding 

low  .arrival 
with  aiding 

high  arrival 
without  aiding 

high  arrival 
with  aiding 

htrh  arrival 
with  aiding 

Mgh  arrival 
without  aidirt  | 

low  arrival 
with  aiding 

low  arrival 
without  aiding 

high  arrival  | 
without  aidtrr  1 

r.wn  arrival 
with  MJinr 

l.w  arrival 
without  aiding 

low  arrival 
with  aiding 

(training) 

(training) 

(•.raining) 

Ctr.nnirg) 

no  arrival 

no  arrival 

no  arrival 

no  arrival 

low  arrival 
with  aiding 

low  arrival 
without  aiding 

hlfh  arrival 
with  aiding 

high  .-i-rival 
without  aiding 

low  arrival 
without  aising 

low  arrival 

with  jidir.g 

hirh  .irrivvl 
wi*r>ut  at.:iRg 

hirh  arrival 
with  ii.dirg 

AutoptloC 

with 

high  arrival 
with  .nidirg 

hi.-h  .wrtval 
wlthoiit  aidirg 

Ifw  amv.«l 
with  aidina 

low  .'•rrjval 
without  aiding 

high  arrival 
without  aiding 

nirh  .•rrtrf.il 
with  .aiding 

iCM  ;r-lv4t 

with.-ut  aidirr 

-w  ,-.r--v»l 

With  aiding 

low  arrival 
sdaotlvc  aid 

low  arrival 
adapt ive  aid 

hirh  arrival 
a4tootive  aid 

•ilfh  arrival 
adopt tve  aie 

hirh  arrival 
adaptive  aid 

him  .arrival 
adaptive  .aid 

Irw  .arrtv.'l 
vjoctive  aid 

low  .irrtval 

adopt  r.e  .I  Id 

For  the  experiment  runs  with  perfect  autopilot,  only  the  subsystem  task 
was  considered.  An  "autopilot"  kept  the  aircraft  on  course  and  on  schedule. 
These  runs  served  as  baseline  performance  for  the  subsystem  task.  In  the 
manual  control  runs,  the  subject  had  to  perform  both  subsystem  and  control 
task.  He  was  told  that  the  control  task  was  more  important  than  the 
subsystem  task.  For  the  runs  where  autopilot  maufunctions  were  posible,  the 
autopilot  was  available  during  most  of  the  experiment  such  that  the  subject 
was  not  required  to  fly  the  airplane  except  to  occasionally  check  autopilot 
performance.  As  soon  as  he  detected  an  autopilot  malfunction,  which  was 
characterized  by  the  airplane  deviating  from  the  mapped  course  at  a  rate  of 
one  degree  per  second,  he  was  required  to  take  over  the  flight  control  task, 
and  fly  the  airplane  back  to  the  mapped  course.  In  this  case,  the  airplane 
would  lock  on  the  desired  course  as  soon  as  it  flew  within  the  800-feet  oval 
of  the  on-schedule  circle,  and  the  autopilot  mode  was  restored.  The 
autopilot  malfunction  happened  relatively  infrequently,  based  on  a  Poison 
distribution  with  mean  inter-arrival  time  of  160  seconds. 
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separate  test  showed  that  the  adaptive  policy  was  also  significant,  i.e.,  the 
adaptive  aiding  further  reduced  the  subsystem  waiting  time  beyond  the 
fixed-threshold  aiding,  even  though  the  adaptive  policy  was  only  effective 
during  a  small  portion  of  time  in  the  experiment. 

The  subjective  “atings  of  the  level  of  effort  across  subjects  are  shown 
in  Figure  5.  Factors  of  significance  include  all  three  experiment  variables. 
As  expected,  the  perceived  level  of  effort  increased  as  control  involvement 
increased,  as  subsystem  arrival  increased,  and  as  computer  aiding  was 
removed.  However,  a  separate  test  showed  that  the  effect  of  the  adaptive 
policy  was  not  significant,  probably  because  the  adaptive  policy  was  employed 
rather  infrequently,  and  when  it  was  being  used,  the  subjects  usually  were 
too  involved  with  restoring  the  autopilot  to  notice  the  fact  that  the 
computer  w.i  j  helping  more  often  then  usual. 


SubsystM  Arrival  fate  (see*’) 


Figure  4  Average  Subsystem  Delay.  Figure  5  Subjective  Ratings  of  Effort. 

fhe  RMS  course  error  across  subjects  is  shown  in  Figure  6.  The  analysis 
of  variance  showed  that  only  control  mode  had  an  effect  on  the  control  error. 
No  consistent  variation  in  the  course  error  was  shown  as  subsystem  arrival 
rate  or  aiding  situation  varied.  The  lower  course  RMS  error  for  the 
autopilot  malfunction  mode  probably  resulted  from  subject's  more  intense 
attention  to  the  control  task  in  the  case  of  malfunction. 

The  RMS  roll  angle  across  subjects  is  shown  in  Figure  7.  Also,  only 
control  mode  had  a  significant  effect  on  the  control  input.  The  subjects 
were  found  to  use  more  extreme  control  actions  and  more  attention  to  fulfill 
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Figure  6.  HMS  Course  Error. 


Figure  7.  RMS  Roll  Angle. 
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given  situation.  The  comparison  of  subsystem  waiting  statistics  is  shown  in 
Table  2. 


Table  2.  Comparison  of  Waiting  Time. 


Ar  'Ival 

Aiding 

Mean 

Standard  Deviation 

Rate 

Type 

Model 

Data 

Model 

Data 

Autopilot  Mode 

6.04 

Lou 

No  Aiding 

9.73 

9.71 

5.39 

Low 

Aiding 

9.34 

9.82 

4.30 

5.13 

High 

No  Aiding 

14.71 

15.79 

13.46 

14,21 

High 

Aiding 

13.79 

13.16 

12.00 

7.43 

Manual 

Mode 

Low 

No  Aiding 

20.13 

23.62 

16,24 

23.53 

Low 

Aiding 

17.56 

17.17 

10.26 

11.31 

High 

No  Aiding 

32.87 

27>81 

45.51 

28.64 

High 

Aiding 

19.58 

19.19 

11.85 

12.17 

Autopilot  Kal function  Mode 

Low 

No  Aiding 

la.oo 

14.25 

8.85 

13.81 

Low 

Aiding 

11.13 

12.84 

6.79 

10,52 

Low 

Adaptive  Aiding 

10.25 

10.68 

4.91 

5.52 

High 

No  Aiding 

17e47 

19.03 

18.96 

21.16 

High 

Aiding 

13.66 

15.52 

8.52 

11.55 

High 

Adaptive  Aiding 

12.32 

13.25 

7.10 

8.33 

In  the  model,  a  Poison  distribution  of  control  event  arrivals  and  an 
Erlang  distribution  of  control  service  times  with  shape  parameter  k=2  were 
assumed.  To  generate  the  results  in  Table  2,  the  values  of  0.1  sec“^  (in 
manual  mode)  and  0.16  (in  malfunction  mode)  were  used  as  mean  control  arrival 
rates,  and  0.47  and  0.34  as  mean  control  service  rates.  These  values  were 
obtained  by  analyzing  subject’s  aileron  control  input  and,  serve  as  a  first 
approximation . 

The  results  compare  reasonably  well.  All  parameters  in  the  model  were 
empirically  measured  and  no  adjustments  were  made.  The  model  predicts 
performance  in  autopilot  mode  very  well.  A  better  estimate  of  control  task 
parameters  will  surely  improve  the  model  accuracy  in  manual  control  and 
autopilot  malfunction  modes. 


CONCLUSION 

The  experimental  results  show  that  all  the  experimental  variables,  i.e., 
the  subsystem  arrival  rates,  the  control  task  involvement,  and  the 
availability  of  computer  aiding,  were  statistically  significant  in  terms  of 
affecting  the  performance  measures  of  interest,  mainly,  the  subsystem  delays, 
and  subjective  effort  ratings.  It  was  shown  that  the  aiding  enhanced  system 
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TIME  ESTIMATION  AS  A  SECONDARY  TASK  TO  MEASURE  WORKLOAD: 
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Abstract 

This  paper  outlines  the  results  of  a  series  of  experiments  designed  to 
evaluate  the  utility  of  time  estimation  as  a  secondary  measure  of  piloting 
workload.  Actively  produced  intervals  of  time  were  found  to  increase  in 
length  and  variability,  whereas  retrospectively  produced  intervals  decreased 
in  length  although  they  also  Increased  in  variability  with  the  addition  of  a 
variety  of  flight-related  tasks.  If  pilots  counted  aloud  while  making  a 
production,  however,  the  impacfbf  concurrent  activity  was  minimized,  at 
least  for  the  moderately  demanding  primary  tasks  that  were  selected.  The 
effects  of  feedback  on  estimation  accuracy  and  consistency  were  greatly 
enhanced  if  a  counting  or  tapping  production  technique  was  used.  This 
compares  with  the  minimal  effect  that  feedback  had  when  no  overt  timekeeping 
technique  was  used. 

Actively  made  verbal  estimates  of  sessions  filled  with  different  activi¬ 
ties  decreased  in  length  as  the  amount  and  complexity  of  activities  performed 
during  the  Interval  were  Increased.  Retrospectively  made  verbal  estimates, 
however,  increased  in  length  as  the  amount  and  complexity  of  activities 
performed  during  the  interval  were  increased.  These  results  support  the 
suggestion  that  time  estimation  provides  a  useful  index  of  the  workload 
involved  in  performing  concurrent  tasks. 


*  Supported  by  NASA  Grant  NGR-45-003-i08  to  the  University  of  Utah. 

**  Supported  by  NASA  Grant  NSG  2269  to  the  San  Jose  State  University  Foundation. 
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INTRODUCTION 


The  workload  involved  in  performing  different  manual  control  and  decision 
making  tasks  is  often  difficult  to  measure  within  a  single  task  or  to  compare 
between  different  tasks.  It  is  difficult  to  infer  an  operator’s  workload  from 
his  measurable  performance  because:  1)  individuals  may  compensate  for  addi¬ 
tional  task  load  by  working  harder,  resulting  in  little  measurable  variation 
in  performance  and  2)  the  total  workload  is  composed  of  a  variety  of  sub  tasks 
such  that  performance  on  any  one  may  or  may  not  reflect  varying  degrees  of 
task  load  in  the  others.  In  addition,  different  measurement  techniques 
may  be  required  to  determine  subtask-specific  variation  in  workload. 

The  purpose  of  this  research  prograi.^  was  to  develop  a  battery  of 
primary  task  indices  and  unobtrusive  secondary  tasks  that  would  specif¬ 
ically  measure  the  load  imposed  by  different  subtasks  that  make  up  the 
total  piloting  task  in  order  to  measure  the  overall  workload  in  real  and 
simulated  flight.  Performance  on  secondary  tasks  is  often  used  as  an 
index  of  primary  task  workload.  Secondary  tasks  that  are  commonly  used  often 
load  the  operator  to  determine  his  remaining  capacity  to  perform  additional 
tasks  while  performing  the  primary  task.  However,  it  was  decided  that  tasks 
selected  for  inclusion  in  the  workload  assessment  battery  should  be  unobtru¬ 
sive  and  measure  primary  task  load  with  minimal  interference.  The  tasks  also 
should  be  similar  to  tasks  that  are  normally  performed  in  flight,  easily 
learned,  implemented  and  scored. 

The  results  of  this  research  have  suggested  time  estimation  as  one 
such  secondary  measure  of  the  cognitive  demands  of  piloting  because  it  has 
been  shown  that  an  individual’s  ability  to  estimate  intervals  of  time  varies 
as  a  function  of  concurrent  task  load.  Time  estimation  is  a  task  that  is 
normally  performed  in  flight.  It  is  unobtrusive,  easily  learned.  Implemented 
and  scored  and  is  not  altered  by  repeated  presentations  unless  knowledge  of 
results  is  given. 
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Intra-  and  Inter-Subject  Variability 


Although  Individuals  tend  to  be  consistent  in  the  length  of  their 
time  estimates,  there  are  large  differences  among  different  individuals. 

For  this  reason,  each  subject  should  be  used  as  his  own  control:  estimates 
obtained  under  different  conditions  of  primary  task  load  can  be  most  easily 
and  unambiguously  analyzed  by  comparison  with  estimates  obtained  from  the 
same  subject  in  the  absence  of  concurrent  task  demands.  Individual  estimation 
accuracy  seems  to  be  a  less  important  measure  than  are  the  direction  of  change 
in  the  length  of  estimates  and  the  increase  in  variability  of  estimates  with 
the  addition  of  a  primary  task. 

Estimation  Measurement  Method 

Four  methods  have  been  used  extensively  to  measure  an  individual's 
ability  to  estimate  or  produce^pecif ied  intervals  of  clock  time.  The 
verbal  estimation  method  requires  that  individuals  vocalize  or  record 
their  judgement  of  the  duration  of  an  operationally  presented  interval. 

The  production  method  requires  that  subjects  physically  generate  an 
interval  whose  duration  is  specified  by  the  experimenter.  The  repro¬ 
duction  method,  which  combines  elements  of  verbal  estimation  and  produc¬ 
tion,  requires  the  operational  production  of  an  interval  whose  duration 
was  presented  operationally.  The  method  of  comparison  involves  a 
relative  judgement  between  the  durations  of  two  or  more  operationally 

presented  intervals. 


Estimation  Mode 

Rather  than  being  perceived  directly,  the  temporal  aspects  of 
experiences  are  inferred  or  deduced  from  the  events  that  occur  in 
time.  Man  has  adopted  objective  standards  and  labels  to  allow 
quantification  of  and  communication  about  temporal  experiences  because 
of  the  difficulties  involved  in  dealing  with  time  in  the  abstract. 
Individuals  represent  durations  subjectively  by  correlating  personally 
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experienced  events  with  objective  temporal  standards  or  rules,  such  as 
clocks. 

Active  Mode 

When  individuals  must  produce  a  specific  duration  or  verbally 
estimate  the  length  of  a  presented  interval  unaided  by  an  objective 
timing  device,  they  may  rely  on  impressions  of  past  events  or  mentally 
or  physically  replay  or  generate  a  sequence  of  events  that  is  believed 
to  last  a  specific  interval  of  time  in  order  to  make  the  temporal 
dimension  of  the  interval  concrete.  This  mode  of  estimation  has  been 
referred  to  as  active  estimation  (ref.  1). 

Retrospective  mode 

Individuals  may  also  make  temporal  estimates  without  attending  to 
time  as  it  passes.  They  may  estimate  the  duration  of  an  interval  at 
its  conclusion  by  comparing  the  number  and  complexity  of  events  that 
occurred  during  the  interval  with  remembered  durations  of  intervals 
similarly  filled  (ref.  2).  This  mode  of  estimation  has  been  referred 
to  as  retrospective  estimation  (ref.  1). 


Influence  of  Concurrent  Activity  on  Active  Estimation 

The  attention  demanded  by  concurrent  activity  tends  to  interfere 
with  active  estimation.  Whenever  attention  is  diverted  from  active 
estimation,  time  passes  unnoticed  so  that  individuals  may  wait  too 
long  to  terminate  a  production  or  verbally  underestimate  the  length 
of  the  interval. 

Active  productions 

Hart  and  McPherson  (ref.  3)  and  Hart  and  Simpson  (ref.  4)  have 
shown  that  subjects  do  indeed  wait  too  long  to  terminate  their  pro¬ 
ductions  when  distracted  from  active  time  estimation  by  competing 
simple  compensatory  tracking  tasks  (fig.  1)  or  speech  recognition. 

A  series  cf  stylized  representatious  of  the  mean  length  ot  10  sec 
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Figure  2. 


REPRESENTATIVE  DISTRIBUTIONS  OF  10-SEC  PRODUCED 
DURATIONS:  INFLUENCE  OF  CONCURRENT  ACTIVITY 
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productions  obtained  under  different  experimental  conditions  Is  given  in 
figure  2.  Each  distribution’s  shape  approximates  that  of  actual  data  obtained 
and  was  drawn  to  include  three  standard  deviations  about  the  obtained  mean. 

As  the  demands  of  the  concurrent  tracking  and  recognition  tasks  ware  increased, 
the  length  of  produced  durations  Increased  by  4  sec  or  more  and  their 
variability  more  than  doubled.  Other,  less  demanding  concurrent  tasks,  such 
as  monitoring  continuous  aviation  weather  broadcasts,  were  also  associated 
with  an  Increase  in  the  central  tendency  and  variability  of  estimate 
•distributions,  but  to  a  lesser  degree,  as  one  would  expect  from  their  less 
demanding  nature. 

Active  verbal  estimates 

Hart  (ref.  5)  and  Hart,  McPherson,  Krelfeldt,  and  Wempe  (ref.  6) 
found  that  actively  made  verbal  estimates  decreased  in  length  with 
the  addition  of  either  a  simple  compensatory  tracking  task  (fig.  3) 
or  a  complex  multi-manned  flight* simulation  (fig.  4b).  The  more 
difficult  levels  of  each  task  were  associated  with  the  shortest 
active  verbal  estimates.  This  is  consistent  with  the  finding  that 
active  verbal  estimation  and  active  production  are  reciprocally 
related,  and  the  observed  directions  of  change  in  estimated  and  pro¬ 
duced  durations  are  both  the  consequence  of  underestimation  of  the 
passage  of  time. 

Influence  of  Concurrent  Activity  on  Retrospective  Estimation 

As  the  attention  demands  of  a  primary  task  increase,  there  is  less 
and  less  attention  available  for  time  estimation.  When  active  estimation 
becomes  impossible  the  retrospective  mode  of  estimation  becomes  necessary. 

Here,  one  presumably  remembers  the  events  that  occurred  during  the  interval, 
compares  them  to  other  experiences  with  known  duration,  and  then  verbally 
estimates  the  duration  of  the  Interval  or  decides  whether  or  not  it  is 
^iaie  to  terminate  a  production.  As  the  number  and  complexity  of  events 
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that  fill  the  Interval  are  increased,  there  is  a  tendency  toward  over¬ 
estimation  of  the  amount  of  time  that  has  passed  resulting  in  the  termina¬ 
tion  of  produced  durations  too  soon  or  the  verbal  overestlnation  of  elapsed 
time.  Note  that  the  directions  of  change  in  retrospectively  verbally 
estimated  and  produced  durations  are  the  opposite  of  those  obtained  with 
active  estimation  and  production  and  again  the  length  of  verbal  estimates 
and  productions  are  reciprocally  related. 


Retrospective  productions 

Hart  and  McPherson  (ref.  3)  have  shown  that  the  central  tendency  of 
10  sec  productions,  obtained  from  pilots  during  simulated  flight,  decreased 
in  length,  as  predicted,  and  the  variability  of  the  produced  durations 
increased  in  comparison  to  estimates  obtained  with  no  competing  activity, 
(fig.  5)  Pilots  reported  that  active  estimation  was  difficult,  resulting 
in  their  use  of  the  retrospective  mode.  The  distributions  of  retrospec¬ 
tively  made  productions  were  also  positively  skewed  due  to  a  few  very  long 
estimates  which  resulted  from  the  estimation  task  occasionally  being 
forgotten  under  conditions  of  high  concurrent  task  load. 


Retrospective  verbal  estimates 

Following  a  complex  multi-manned  simulation  flight,  (ref.  6)  pilot 
indicated  that  66%  of  their  estimates  of  the  length  of  time  taken  to  fly 
the  final  two  miles  of  an  approach  were  made  retrospectively  and  that  the 
proportion  of  retrospectively  made  estimates  increased  as  the  difficulty 
of  the  approach  increased,  (fig.  4a)  Retrospectively  made  estimates 
were  consistently  longer  than  were  estimates  that  pilots  reported  that 
they  had  made  actively  as  predicted,  (fig.  4b) 

Interaction  of  Estimation  Technique  and  Concurrent  Task 

Within  the  active  mode  of  estimation  there  are  many  timekeeping 
techniques  available.  A  standardized,  rhythmic  temporal  metric  (such  as 
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tapping)  not  only  fixes  an  individual’s  attention  on  the  tine  estimation 
task,  which  is  otherwise  difficult  to  do  for  a  task  as  abstract  and 
stimulus-deficient  as  time  estimation,  but  also  provides  a  concrete, 
repeatable  way  to  keep  track  of  time.  Timekeeping  techniques  that  are 
not  externalized,  however,  are  more  easily  disrupted  by  additional, 
more  compelling  activities  and  are  less  stable  across  time.  Some 
of  the  estimation  techniques  that  subjects  have  reported  using  to  keep 
track  of  time  Include  counting,  tapping,  mentally  replaying 
a  phrase  of  music  estimated  to  have  the  appropriate  duration,  mentally 
rehearsing  the  pre-flight  checklist  for  a  helicopter,  counting  heart 
beats  or  breaths,  picturing  the  dial  of  a  clock  with  a  second  hand  moving 
around  it,  or  "just  waiting"  for  10  sec.  Of  these  techniques,  those 
that  are  externalized,  such  as  counting,  provide  standard,  repeatable 
units  with  which  to  mark  off  intervals  of  time  resulting  in  improved 
estimation  stability.  Mental  rehearsal  of  remembered  experiences 
judged  to  have  the  appropriate  duration  resulted  in  less  stable 
productions,  because  the  interval  that  was  repeated  may  or  may  not  have 
lasted  the  appropriate  duration.  Further,  it  is  difficult  to  control 
the  rate  at  which  one's  mind  steps  through  a  memory. 

Hart,  Loomis  and  Wempe  (ref.  7)  found  that  when  attention  was 
focused  on  a  time  production  task  by  requiring  subjects  to  rhythmically 
count  aloud  1-sec  Intervals,  production  accuracy  and  consistency  were 
not  affected  by  the  addition  of  a  concurrent  task.  (fig.  6  and  fig.  7) 

With  no  overt  counting,  however,  the  length  and  variability  of  produced 
durations  increased  significantly  with  the  addition  of  a  tracking  Cask, 
replicating  earlier  results  (ref.  3).  Because  performance  on  the  track¬ 
ing  task  was  the  same  with  both  productions  techniques,  it  appears  that 
the  shift  in  attention  away  from  time  production  found  with  the  no-counting 
technique  was  not  because  subjects  could  not  innately  perform  both  tasks 
but  merely  that  they  in  fact  did  not.  When  attention  was  focused  on  the 
;  time  production  task  by  the  counting  technique,  production  accuracy  was 
not  degraded  and  there  was  no  concomitant  degredation  of  tracking  task 
performance. 
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Figure  7. 


DURATIONS  OF  THE  7  PRODUCTION  MADE  BY  EACH 
SUBJECT  UNDER  SIX  EXPERIMENTAL  CONDITIONS 
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It  is  likely  that  more  demanding  concurrent  activity,  such  as 
simulated  flight,  would  also  Impact  the  consistency  of  durations 
produced  with  a  counting  technique.  However,  no  such  effects  were  found 
with  the  moderately  da^nding  tracking  tasks  that  were  used. 

Interaction  of  Estimation  Technique  and  Feedback 


If  the  ability  to  estimate  and  produce  intervals  of  time  is  learned, 
then  it  is  likely  that  knowledge  of  results  (feedback)  should  enhance 
timekeeping  accuracy  and  consistency.  In  addition,  the  use  of  estimation 
techniques  that  provide  rhythmic  division  of  an  interval  into  standard, 
repeatable  units  should  focus  attention  on  timekeeping  and  make  the 
temporal  dimension  of  the  interval  more  concrete,  thereby  enhancing 
an  individual's  ability  to  take  advantage  of  feedback. 

In  a  recent  study.  Hart.  Loomis  and  Wempe  (ref.  8)  found  that 
individuals,  using  estimation  techniques  that  did  not  involve  some  sort 
of  overt  counting,  made  less  efficient  initial  use  of  feedback  and  did 


not  experience  any  long  term  benefits  from  feedback.  Overall  accuracy 
of  10-sec  productions,  but  not  variability,  was  improved  significantly 
by  the  presentation  of  feedback,  with  a  rapid  return  to  prefeedback 
performance  levels  when  feedback  was  removed,  (fig.  8  and  fig.  9). 

During  feedback,  subjects  repeatedly  overcorrected.  If  told  that  one 
production  was  too  long,  the  next  production  was  typically  too  short  and 
Vice  versa.  Even  after  30  trials  with  feedback  following  every  production 
subjects  were  unable  to  estimate  accurately  from  trial  to  trial  even 
though  their  estimate  durations  appeared  to  be  accurate  overall.  If 
the  subjects  were  Instructed  to  rhythmically  tap  a  button  at  1-sec 
intervals  in  order  to  produce  a  series  of  10-sec  durations,  both 
accuracy  and  variability  were  improved  significantly  by  the  addition 
of  feedback.  This  Improvement  persisted  for  at  least  as  long  as  30 
additional  trials  after  feedback  was  removed.  With  this  production 


technique,  subjects  were  able  to  maintain  consistent  and  accurate 
estimates  from  trial  to  trial,  and  did  not  overcorrect  as  they  had 


707 


/ 


Figure  8. 


REPRESENTATIVE  DISTRIBUTIONS  OF  10-SEC  PRODUCE 
DURATIONS:  INFLUENCE  OF  KNOWLEDGE  OF  RESULTS 
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with  the  no-counting  technique.  The  data  suggest  that  tapping  rhythmic¬ 
ally  not  only  provides  a  standardized  repeatable  temporal  metric,  but 
also  fixes  subject *s  attention  on  the  time  production  task,  which 
together  combine  to  enable  subjects  to  use  feedback  more  effectively. 

Conclusion 

As  a  result  of  the  foregoing  research  effort,  several  recommendations 
can  be  made  concerning  the  use  of  time  estimation  as  a  secondary 
measure  of  the  attention  demands  of  a  primary  task. 

Method 

The  production  of  brief  intervals  of  time  appears  to  be  the  most 
useful  experimental  method.  The  duration  and  variability  of  time 
productions  in  the  range  of  1  to  30  sec  have  been  shown  to  reflect  the 
attention  demands  of  primary  manual  control,  message  recognition,  and 
simulated  flight  tasks.  Relatively  brief  intervals  should  be  used  so 
that  the  primary  task  load  remains  reasonably  uniform  and  describable 
during  the  produced  interval. 

The  verbal  estimation  method  also  shows  some  promise  as  a  secondary 
measure  of  primary  task  workload.  Its  primary  advantage  over  the  production 
method  is  ease  of  implementation.  Its  primary  disadvantage  is  that  subjects 
tend  to  round  off  their  estimates,  thereby  losing  precision,  and  their 
responses  tend  to  become  stereotyped  if  a  number  of  estimates  are  required. 
This  method  appears  to  have  some  value,  but  is  less  sensitive  than  the 
method  of  production. 

Mode 

Estimation  mode  (active  or  retrospective  production  or  verbal  esti¬ 
mation)  must  also  be  controlled  or  identified  to  obtain  reliable  and 
clear  results  with  a  time  estimation  task.  Because  retrospective  produc¬ 
tions  decrease  in  length  with  increasing  task  load  whereas  active  produc¬ 
tions  Increase  in  length,  care  must  be  taken  to  identify  the  mode  of 
production  used.  If  retrospective  and  active  productions  are  combined 
in  an  analysis,  their  direction  of  change  with  the  addition  of  another 
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task  would  tend  to  cancel  out  masking  detailed  changes  in  the  under¬ 
lying  processes. 

Technique 

timekeeping  techniques  that  are  not  externalized  are  most  easily 
disrupted  by  concurrent  task  demands  and  thus  provide  the  most  useful 
measure  of  primary  task  demands.  Thus,  if  time  production  is  to  be  used 
as  a  measure  of  workload,  subjects  should  not  be  allowed  to  use  any  overt 
time  estimation  technique  such  as  tapping  or  counting.  If  estimation 
accuracy  and  consistency  are  required,  however,  an  overt  timekeeping 
technique  should  be  used.  Further  research  is  required  to  determine 
at  what  level  of  concurrent  task  load  the  overt  estimation  technique 
would  also  be  disrupted. 

Feedback 


If  an  ovart-^timekeeping -technique  isnised,  feedback  is  effective 
in  reducing  both  error  and  variability  after  only  two  or  three  repetitions, 
and  the  effects  of  feedback  last  long  after  it  has  been  removed.  With  no 
overt  timekeeping  technique,  however,  estimation  error  is  reduced  only  on 
the  average,  and  variability  remains  high  with  a  rapid  return  to  pre¬ 
feedback  error  levels  following  removal  of  feedback. 

Data  Analysis 

Time  estimation  performance  is  best  evaluated  relatively.  That  is, 
the  amount  and  direction  of  change  in  estimation  accuracy  and  consistency 
observed  in  the  presence  of  additional  primary  tasks  should  be  compared 
to  estimates  obtained  from  the  same  subject  with  no  additional  activity. 
Care  should  also  be  taken  to  select  the  appropriate  measures  of  central 
tendency  and  variability  as  distributions  of  time  productions  are  often 
positively  skewed,  particularly  when  obtained  in  the  presence  of  competing 
concurrent  activity. 
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